Method for encoding and decoding motion information, and apparatus for encoding and decoding motion information

ABSTRACT

A method of decoding motion information according to an embodiment includes: obtaining information indicating a disparity distance for determining a prediction motion vector of a current block; scaling the disparity distance corresponding to the obtained information, based on a comparison result between a base pixel unit and a smallest pixel unit indicatable by a motion vector of the current block; determining a prediction motion vector candidate changed by the scaled disparity distance from a base motion vector of the current block from among one or more prediction motion vector candidates as the prediction motion vector of the current block; and determining the motion vector of the current block by using the prediction motion vector.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation Application of U.S. patentapplication Ser. No. 16/647,376 filed Mar. 13, 2020, which is a NationalStage of International Application No. PCT/KR2018/010666 filed on Sep.12, 2018, which claims priority to Provisional U.S. Application No.62/560,342 filed on Sep. 19, 2017, the disclosures of which areincorporated herein in their entireties by reference.

TECHNICAL FIELD

The present disclosure relates to the field of image encoding anddecoding. More particularly, the present disclosure relates to a methodand apparatus for encoding motion information used for image encodingand decoding, and a method and apparatus for decoding motion informationused for image encoding and decoding.

BACKGROUND ART

In a method of encoding and decoding an image, in order to encode animage, one picture may be split into blocks and each of the blocks maybe prediction encoded by using inter prediction or intra prediction.

Inter prediction refers to a method of compressing an image by removingtemporal redundancy between pictures, a representative example of whichis motion estimation encoding. In motion estimation encoding, each blockof a current picture is predicted by using at least one referencepicture. A reference block that is most similar to a current block isfound within a predetermined search range by using a predeterminedevaluation function. A current block is predicted based on a referenceblock, and a residual block generated by subtracting from the currentblock a prediction block generated as a prediction result is encoded. Inthis case, in order to more accurately perform prediction, interpolationis performed on a search range of the reference picture, sub-pel-unitpixels smaller than integer-pel-unit pixels may be generated, and interprediction may be performed on the generated sub-pel-unit pixels.

In a codec such as H.264 advanced video coding (AVC) and high efficiencyvideo coding (HEVC), in order to predict a motion vector of a currentblock, a motion vector of previously encoded blocks adjacent to thecurrent block or blocks included in a previously encoded picture is usedas a prediction motion vector of the current block. A differentialmotion vector that is a difference between the prediction motion vectorand the motion vector of the current block is signaled to a decoder byusing a predetermined method.

DESCRIPTION OF EMBODIMENTS Technical Problem

There are provided a method of encoding and decoding motion informationand an apparatus for encoding and decoding motion information accordingto an embodiment, which may represent motion information by using asmall number of bits.

There are also provided a method of encoding and decoding motioninformation and an apparatus for encoding and decoding motioninformation according to an embodiment, which may signal more accuratemotion information by using a small number of bits.

Solution to Problem

A method of decoding motion information according to an embodiment ofthe present disclosure may include obtaining information indicating adisparity distance for determining a prediction motion vector of acurrent block; scaling the disparity distance corresponding to theobtained information, based on a comparison result between a base pixelunit and a smallest pixel unit indicatable by a motion vector of thecurrent block; determining, as the prediction motion vector of thecurrent block, a prediction motion vector candidate that is changed bythe scaled disparity distance from a base motion vector of the currentblock from among at least one prediction motion vector candidate; anddetermining the motion vector of the current block by using theprediction motion vector.

Advantageous Effects of Disclosure

A method of encoding and decoding motion information and an apparatusfor encoding and decoding motion information according to an embodimentmay represent motion information by using a small number of bits.

Also, a method of encoding and decoding motion information and anapparatus for encoding and decoding motion information may signal a moreaccurate motion vector by using a small number of bits.

However, effects achievable by a method of encoding and decoding motioninformation and an apparatus for encoding and encoding motioninformation according to an embodiment are not limited thereto, andother unmentioned effects will be apparent to one of ordinary skill inthe art from the following description.

BRIEF DESCRIPTION OF DRAWINGS

A brief explanation of each drawing is provided to more fully understandthe accompanying drawings.

FIG. 1 is a block diagram of an image decoding apparatus capable ofdecoding an image based on at least one of block shape information andsplit shape information, according to an embodiment.

FIG. 2 is a block diagram of an image encoding apparatus capable ofencoding an image based on at least one of block shape information andsplit shape information, according to an embodiment.

FIG. 3 illustrates a process of determining at least one coding unit bysplitting a current coding unit, according to an embodiment.

FIG. 4 illustrates a process of determining at least one coding unit bysplitting a non-square coding unit, according to an embodiment.

FIG. 5 illustrates a process of splitting a coding unit based on atleast one of block shape information and split shape information,according to an embodiment.

FIG. 6 illustrates a method of determining a predetermined coding unitfrom among an odd number of coding units, according to an embodiment.

FIG. 7 illustrates an order of processing a plurality of coding unitswhen the plurality of coding units are determined by splitting a currentcoding unit, according to an embodiment.

FIG. 8 illustrates a process of determining that a current coding unitis to be split into an odd number of coding units, when the coding unitsare not processable in a predetermined order, according to anembodiment.

FIG. 9 illustrates a process of determining at least one coding unit bysplitting a first coding unit, according to an embodiment.

FIG. 10 illustrates that a shape into which a second coding unit issplittable is restricted when the second coding unit having a non-squareshape, which is determined by splitting a first coding unit, satisfies apredetermined condition, according to an embodiment.

FIG. 11 illustrates a process of splitting a square coding unit whensplit shape information indicates that the square coding unit is not tobe split into four square coding units, according to an embodiment.

FIG. 12 illustrates that a processing order between a plurality ofcoding units may be changed depending on a process of splitting a codingunit, according to an embodiment.

FIG. 13 illustrates a process of determining a depth of a coding unit asa shape and size of the coding unit change, when the coding unit isrecursively split such that a plurality of coding units are determined,according to an embodiment.

FIG. 14 illustrates depths that are determinable based on shapes andsizes of coding units, and part indexes (PIDs) for distinguishing thecoding units, according to an embodiment.

FIG. 15 illustrates that a plurality of coding units are determinedbased on a plurality of predetermined data units included in a picture,according to an embodiment.

FIG. 16 illustrates a processing block serving as a unit for determininga determination order of reference coding units included in a picture,according to an embodiment.

FIG. 17 illustrates coding units determinable per picture when acombination of shapes into which a coding unit is splittable isdifferent per picture, according to an embodiment.

FIG. 18 illustrates various shapes of a coding unit determinable basedon split shape information representable as a binary code, according toan embodiment.

FIG. 19 illustrates other shapes of a coding unit determinable based onsplit shape information representable as a binary code, according to anembodiment.

FIG. 20 is a block diagram of an image encoding and decoding system forperforming loop filtering.

FIG. 21 is a block diagram of an image decoding apparatus according toan embodiment.

FIGS. 22 through 25 each illustrate prediction motion vector candidatesdisplayed on a coordinate plane.

FIG. 26 is a diagram illustrating prediction motion vector candidatesdetermined based on a disparity distance scaled according to a smallestpixel unit.

FIG. 27 is a diagram for describing a method of changing a base motionvector candidate.

FIG. 28 is a diagram for describing an index indicating predictionmotion vector candidates, according to an embodiment.

FIG. 29 is a diagram for describing motion information used forbi-directional prediction of a block.

FIG. 30 is a diagram illustrating a positional relationship between acurrent picture and two reference pictures.

FIG. 31 is a diagram illustrating prediction motion vector candidatesfor a current block that is bi-directionally predicted.

FIG. 32 is a diagram illustrating a positional relationship between acurrent picture and two reference pictures.

FIG. 33 is a diagram illustrating prediction motion vector candidatesfor a current block that is bi-directionally predicted.

FIG. 34 is a diagram for describing a process, performed by an imagedecoding apparatus, of obtaining a parameter related to a preset mode,according to an embodiment.

FIG. 35 is a flowchart for describing an image decoding method accordingto an embodiment.

FIG. 36 is a block diagram of an image encoding apparatus according toan embodiment.

FIG. 37 is a flowchart for describing an image encoding method accordingto an embodiment.

BEST MODE

A method of decoding motion information according to an embodiment ofthe present disclosure includes: obtaining information indicating adisparity distance for determining a prediction motion vector of acurrent block; scaling the disparity distance corresponding to theobtained information, based on a comparison result between a base pixelunit and a smallest pixel unit indicatable by a motion vector of thecurrent block; determining a prediction motion vector candidate changedby the scaled disparity distance from a base motion vector of thecurrent block from among one or more prediction motion vector candidatesas the prediction motion vector of the current block; and determiningthe motion vector of the current block by using the prediction motionvector.

In an embodiment, the scaling of the disparity distance may includescaling the disparity distance based on a ratio between the base pixelunit and the smallest pixel unit.

In an embodiment, the obtaining of the information indicating thedisparity distance may include obtaining information indicating adisparity direction, and the determining of the prediction motion vectorcandidate changed by the scaled disparity distance as the predictionmotion vector of the current block may include determining theprediction motion vector candidate changed by the scaled disparitydistance according to the disparity direction corresponding to theobtained information from the base motion vector of the current block asthe prediction motion vector of the current block.

In an embodiment, the obtaining of the information indicating thedisparity direction may include obtaining at least one from among theinformation indicating the disparity distance and the informationindicating the disparity direction by entropy decoding a bit valueincluded in a bitstream according to a context model.

In an embodiment, the obtaining of at least one from among theinformation indicating the disparity distance and the informationindicating the disparity direction may include obtaining at least onefrom among the information indicating the disparity distance and theinformation indicating the disparity direction, based on informationrelated to a previously decoded block to which the same prediction modeas a prediction mode applied to the current block is applied.

In an embodiment, the method may further include determining one basemotion vector candidate from among one or more base motion vectorcandidates as the base motion vector of the current block.

In an embodiment, the method may further include scaling one or moredisparity distances that are pre-determined based on the base pixelunit, based on the smallest pixel unit; and determining one or moreprediction motion vector candidates changed by the scaled one or moredisparity distances from a base motion vector candidate, according tothe one or more base motion vector candidates.

In an embodiment, the determining of the one or more prediction motionvector candidates may include: changing a base motion vector candidatecapable of indicating a pixel unit smaller than the smallest pixel unitfrom among the one or more base motion vector candidates based on thesmallest pixel unit; and determining the one or more prediction motionvector candidates changed by the scaled one or more disparity distancesfrom the changed base motion vector candidate.

In an embodiment, the one or more pre-determined disparity distances maybe differently determined for the one or more base motion vectorcandidates.

In an embodiment, the determining of the one or more prediction motionvector candidates may include: determining one or more prediction motionvector candidates of a first uni-direction changed by the scaled one ormore disparity distances from a base motion vector candidate of thefirst uni-direction, for a bi-directional base motion vector candidate;re-scaling the scaled one or more disparity distances, based on apositional relationship among a current picture including the currentblock, a first reference picture indicated by the base motion vectorcandidate of the first uni-direction, and a second reference pictureindicated by a base motion vector candidate of a second uni-direction;and determining one or more prediction motion vector candidates of thesecond uni-direction changed by the re-scaled one or more disparitydistances from the base motion vector candidate of the seconduni-direction.

In an embodiment, a disparity direction of the one or more predictionmotion vector candidates of the second uni-direction may be the same asor opposite to a disparity direction of the one or more predictionmotion vector candidates of the first uni-direction.

In an embodiment, the determining of the prediction motion vectorcandidate changed by the scaled disparity distance as the predictionmotion vector of the current block may include, when the disparitydistance corresponding to the obtained information is 0, determining thebase motion vector of the current block as the prediction motion vectorof the current block.

In an embodiment, the method may further include, when it is determinedthat a first prediction mode is applied to the current block, obtaininginformation indicating whether a second prediction mode is applied tothe current block from a bitstream, wherein the information indicatingthe disparity distance is obtained when the second prediction mode isapplied to the current block.

In an embodiment, the determining of the motion vector of the currentblock may include: obtaining, from a bitstream, a differential motionvector related to the current block; and determining the motion vectorof the current block by applying the differential motion vectorcorresponding to the information indicating the differential motionvector to the prediction motion vector.

A method of encoding motion information according to an embodiment ofthe present disclosure includes: scaling one or more disparity distancesthat are pre-determined based on a base pixel unit, based on a smallestpixel unit indicatable by a motion vector of a current block;determining one or more prediction motion vector candidates changed bythe scaled one or more disparity distances from a base motion vectorcandidate, according to one or more base motion vector candidates;determining a prediction motion vector of the current block from amongthe one or more prediction motion vector candidates; and generating abitstream including information indicating a disparity distance forspecifying a prediction motion vector candidate determined as theprediction motion vector of the current block.

MODE OF DISCLOSURE

As the present disclosure allows for various changes and numerousembodiments, exemplary embodiments will be illustrated in the drawingsand described in detail in the written description. However, this is notintended to limit the present disclosure to particular modes ofpractice, and it is to be appreciated that all changes, equivalents, andreplaces that do not depart from the spirit and technical scope of thepresent disclosure are encompassed in the present disclosure.

In the description of the present disclosure, certain detailedexplanations of the related art are omitted when it is deemed that theymay unnecessarily obscure the essence of the present disclosure. Also,numbers (e.g., first and second) used in the description of embodimentsof the disclosure are intended to merely distinguish one component fromanother.

When a component is referred to as being “connected” or “accessed” to orby any other component, it should be understood that the component maybe directly connected or accessed to or by the other component, butanother new component may also be interposed between them, unlessotherwise specifically indicated.

Regarding an element with a suffix such as ‘unit’ or ‘module’, two ormore elements may be combined into one element or one element may bedivided into two or more elements according to functions. In addition,each of respective components to be described below may additionallyperform some or all functions among functions which other componentstake charge of in addition to a primary function which each componenttakes charge of, and some functions among primary functions which therespective components take charge of may be exclusively performed byother components.

Also, the term ‘image’ or picture’ used herein may refer to a stillimage of a video, or a moving image, i.e., a video itself.

Also, the term ‘sample’ used herein refers to data that is assigned to asampling location of an image and is to be processed. For example,pixels in an image of a spatial domain or transform coefficients in atransform domain may be samples. A unit including one or more samplesmay be defined as a block.

Also, the term ‘current block’ used herein may refer to a block of alargest coding unit, a coding unit, a prediction unit, or a transformunit of a current image to be encoded or decoded.

Also, in the present specification, when a motion vector is in a list 0direction, it may mean that the motion vector is a motion vector used toindicate a block in a reference picture included in a list 0, and when amotion vector is in a list 1 direction, it may mean that the motionvector is a motion vector used to indicate a block in a referencepicture included in a list 1. Also, when a motion vector isuni-directional, it may mean that the motion vector is a motion vectorused to indicate a block in a reference picture included in the list 0or the list 1, and when a motion vector is bi-directional, it may meanthat the motion vector includes a motion vector in the list 0 directionand a motion vector in the list 1 direction.

An image encoding method and apparatus and an image decoding method andapparatus based on transform units and coding units having a treestructure according to an embodiment will be described with reference toFIGS. 1 through 20. An image encoding apparatus 200 and an imagedecoding apparatus 100 to be described with reference to FIGS. 1 through20 may respectively include an image encoding apparatus 3600 and animage decoding apparatus 2100 to be described with reference to FIGS. 21through 37.

FIG. 1 is a block diagram of the image decoding apparatus 100 accordingto an embodiment.

The image decoding apparatus 100 may include a bitstream obtainer 110and a decoder 120. The bitstream obtainer 110 and the decoder 120 mayinclude at least one processor. Also, the bitstream obtainer 110 and thedecoder 120 may include a memory in which instructions to be executed byat least one processor are stored.

The bitstream obtainer 110 may receive a bitstream. The bitstreamincludes information obtained when the image encoding apparatus 200encodes an image as described below. Also, the bitstream may betransmitted from the image encoding apparatus 200. The image encodingapparatus 200 and the image decoding apparatus 100 may be connected toeach other by wire or wirelessly, and the bitstream obtainer 110 mayreceive the bitstream by wire or wirelessly. The bitstream obtainer 110may receive the bitstream from a storage medium such as an opticalmedium or a hard disk. The decoder 120 may reconstruct an image based oninformation obtained from the received bitstream. The decoder 120 mayobtain a syntax element for reconstructing the image from the bitstream.The decoder 120 may reconstruct the image based on the syntax element.

Operations of the image decoding apparatus 100 will be described indetail. The bitstream obtainer 110 may receive a bitstream.

The image decoding apparatus 100 may perform an operation of obtaining abin string corresponding to a split shape mode of a coding unit from thebitstream. The image decoding apparatus 100 may perform an operation ofdetermining a splitting rule of the coding unit. Also, the imagedecoding apparatus 100 may perform an operation of splitting the codingunit into a plurality of coding units, based on at least one of the binstring corresponding to the split shape mode and the splitting rule. Theimage decoding apparatus 100 may determine an allowable first range of asize of the coding unit, according to a ratio between a width and aheight of the coding unit, in order to determine the splitting rule. Theimage decoding apparatus 100 may determine an allowable second range ofa size of the coding unit, according to the split shape mode of thecoding unit, in order to determine the splitting rule.

Splitting of a coding unit according to an embodiment of the presentdisclosure will be described in detail.

First, one picture may be split into one or more slices. One slice maybe a sequence of largest coding units (coding tree units (CTUs)). Thereis a largest coding block (coding tree block (CTB)) conceptuallycompared to a largest coding unit (CTU).

A largest coding block (CTB) refers to an N×N block including N×Nsamples (N is an integer). Each color component may be split into one ormore largest coding blocks.

When a picture has three sample arrays (sample arrays for Y, Cr, and Cbcomponents), a largest coding unit (CTU) includes a largest coding blockof a luma sample, two corresponding largest coding blocks of chromasamples, and syntax structures used to encode the luma sample and thechroma samples. When a picture is a monochrome picture, a largest codingunit includes a largest coding block of a monochrome sample and syntaxstructures used to encode the monochrome samples. When a picture is apicture having color planes separated according to color components, alargest coding unit includes syntax structures used to encode thepicture and samples of the picture.

One largest coding block (CTB) may be split into M×N coding blocksincluding M×N samples (M and N are integers).

When a picture has sample arrays for Y, Cr, and Cb components, a codingunit (CU) includes a coding block of a luma sample, two correspondingcoding blocks of chroma samples, and syntax structures used to encodethe luma sample and the chroma samples. When a picture is a monochromepicture, a coding unit includes a coding block of a monochrome sampleand syntax structures used to encode the monochrome samples. When apicture is a picture having color planes separated according to colorcomponents, a coding unit includes syntax structures used to encode thepicture and samples of the picture.

As described above, a largest coding block and a largest coding unit areconceptually distinguished from each other, and a coding block and acoding unit are conceptually distinguished from each other. That is, a(largest) coding unit refers to a data structure including a (largest)coding block including a corresponding sample and a syntax structurecorresponding to the (largest) coding block. However, because it isunderstood by one of ordinary skill in the art that a (largest) codingunit or a (largest) coding block refers to a block of a predeterminedsize including a predetermined number of samples, a largest coding blockand a largest coding unit, or a coding block and a coding unit arementioned in the following specification without being distinguishedunless otherwise described.

An image may be split into largest coding units (CTUs). A size of eachlargest coding unit may be determined based on information obtained froma bitstream. A shape of each largest coding unit may be a square shapeof the same size. However, the present disclosure is not limitedthereto.

For example, information about a maximum size of a luma coding block maybe obtained from a bitstream. For example, the maximum size of the lumacoding block indicated by the information about the maximum size of theluma coding block may be one of 4×4, 8×8, 16×16, 32×32, 64×64, 128×128,and 256×256.

For example, information about a luma block size difference and amaximum size of a luma coding block that may be split into two may beobtained from a bitstream. The information about the luma block sizedifference may refer to a size difference between a luma largest codingunit and a largest luma coding block that may be split into two.Accordingly, when the information about the maximum size of the lumacoding block that may be split into two and the information about theluma block size difference obtained from the bitstream are combined witheach other, a size of the luma largest coding unit may be determined. Asize of a chroma largest coding unit may be determined by using the sizeof the luma largest coding unit. For example, when a Y:Cb:Cr ratio is4:2:0 according to a color format, a size of a chroma block may be halfa size of a luma block, and a size of a chroma largest coding unit maybe half a size of a luma largest coding unit.

According to an embodiment, because information about a maximum size ofa luma coding block that is binary splittable is obtained from abitstream, the maximum size of the luma coding block that is binarysplittable may be variably determined. In contrast, a maximum size of aluma coding block that is ternary splittable may be fixed. For example,the maximum size of the luma coding block that is ternary splittable inan I-slice may be 32×32, and the maximum size of the luma coding blockthat is ternary splittable in a P-slice or a B-slice may be 64×64.

Also, a largest coding unit may be hierarchically split into codingunits based on split shape mode information obtained from a bitstream.At least one of information indicating whether quad splitting isperformed, information indicating whether multi-splitting is performed,split direction information, and split type information may be obtainedas the split shape mode information from the bitstream.

For example, the information indicating whether quad splitting isperformed may indicate whether a current coding unit is quad split(QUAD_SPLIT) or not.

When the current coding unit is not quad split, the informationindicating whether multi-splitting is performed may indicate whether thecurrent coding unit is no longer split (NO_SPLIT) or binary/ternarysplit.

When the current coding unit is binary split or ternary split, the splitdirection information indicates that the current coding unit is split inone of a horizontal direction and a vertical direction.

When the current coding unit is split in the horizontal direction or thevertical direction, the split type information indicates that thecurrent coding unit is binary split or ternary split.

A split mode of the current coding unit may be determined according tothe split direction information and the split type information. A splitmode when the current coding unit is binary split in the horizontaldirection may be determined to be a binary horizontal split mode(SPLIT_BT_HOR), a split mode when the current coding unit is ternarysplit in the horizontal direction may be determined to be a ternaryhorizontal split mode (SPLIT_TT_HOR), a split mode when the currentcoding unit is binary split in the vertical direction may be determinedto be a binary vertical split mode (SPLIT_BT_VER), and a split mode whenthe current coding unit is ternary split in the vertical direction maybe determined to be a ternary vertical split mode SPLIT_TT_VER.

The image decoding apparatus 100 may obtain split shape mode informationfrom a bitstream from one bin string. The bitstream received by theimage decoding apparatus 100 may include a fixed length binary code, aunary code, a truncated unary code, a pre-determined binary code, etc.The bin string is a binary sequence of information. The bin string mayinclude at least one bit. The image decoding apparatus 100 may obtainthe split shape mode information corresponding to the bin string basedon a splitting rule. The image decoding apparatus 100 may determinewhether or not to quad split a coding unit, a split direction, and asplit type, based on one bin string.

A coding unit may be equal to or smaller than a largest coding unit. Forexample, because a largest coding unit is a coding unit having a maximumsize, the largest coding unit is one of coding units. When split shapemode information about a largest coding unit indicates that splitting isnot performed, a coding unit determined in the largest coding unit hasthe same size as that of the largest coding unit. When split shape codeinformation about a largest coding unit indicates that splitting isperformed, the largest coding unit may be split into coding units. Also,when split shape mode information about a coding unit indicates thatsplitting is performed, the coding unit may be split into smaller codingunits. However, splitting of an image is not limited thereto, and alargest coding unit and a coding unit may not be distinguished from eachother. Splitting of a coding unit will be described in more detail withreference to FIGS. 3 through 16.

Also, one or more prediction blocks for prediction may be determinedfrom a coding unit. A prediction block may be equal to or smaller than acoding unit. Also, one or more transform blocks for transform may bedetermined from a coding unit. A transform block may be equal to orsmaller than a coding unit.

Shapes and sizes of a transform block and a prediction block may not berelated to each other.

In another embodiment, prediction may be performed by using a codingunit as a prediction unit. Also, transform may be performed by using acoding unit as a transform block.

Splitting of a coding unit will be described in more detail withreference to FIGS. 3 through 16. Each of a current block and aneighboring block of the present disclosure may indicate one of alargest coding unit, a coding unit, a prediction block, and a transformblock. Also, a current block or a current coding unit is a block onwhich decoding or encoding is currently performed or a block on whichsplitting is currently performed. A neighboring block may be a blockthat is reconstructed before a current block. A neighboring block may bespatially or temporally adjacent to a current block. A neighboring blockmay be located at one of a left lower side, a left side, a left upperside, an upper side, a right upper side, a right side, and a right lowerside of a current block.

FIG. 3 illustrates a process, performed by the image decoding apparatus100, of determining at least one coding unit by splitting a currentcoding unit, according to an embodiment.

A block shape may include 4N×4N, 4N×2N, 2N×4N, 4N×N, N×4N, 32N×N, N×32N,16N×N, N×16N, 8N×N, or N×8N. N may be a positive integer. Block shapeinformation is information indicating at least one from among a shape, adirection, a ratio between a width and a height, and a size of a codingunit.

The shape of the coding unit may include a square shape and a non-squareshape. When the width and the height of the coding unit are the same(i.e., when the block shape of the coding unit is 4N×4N), the imagedecoding apparatus 100 may determine the block shape information of thecoding unit as a square shape. The image decoding apparatus 100 maydetermine the shape of the coding unit as a non-square shape.

When the width and the height of the coding unit are different from eachother (i.e., when the block shape of the coding unit is 4N×2N, 2N×4N,4N×N, N×4N, 32N×N, N×32N, 16N×N, N×16N, 8N×N, or N×8N), the imagedecoding apparatus 100 may determine the block shape information of thecoding unit as a non-square shape. When the shape of the coding unit isa non-square shape, the image decoding apparatus 100 may determine theratio of the width and the height in the block shape information of thecoding unit as at least one from among 1:2, 2:1, 1:4, 4:1, 1:8, 8:1,1:16, 16:1, 1:32, and 32:1. Also, the image decoding apparatus 100 maydetermine whether the coding unit is in a horizontal direction or avertical direction, based on a length of the width and a length of theheight of the coding unit. Also, the image decoding apparatus 100 maydetermine the size of the coding unit, based on at least one from amongthe length of the width, the length of the height, and an area of thecoding unit.

According to an embodiment, the image decoding apparatus 100 maydetermine a shape of the coding unit by using the block shapeinformation, and may determine which shape the coding unit is split intoby using split shape mode information. That is, a coding unit splittingmethod indicated by the split shape mode information may be determinedaccording to which block shape is indicated by the block shapeinformation used by the image decoding apparatus 100.

The image decoding apparatus 100 may determine the split shape modeinformation from a bitstream. However, the present disclosure is notlimited thereto, and the image decoding apparatus 100 and the imageencoding apparatus 200 may determine the split shape mode informationthat is pre-promised based on the block shape information. The imagedecoding apparatus 100 may determine the split shape mode informationthat is pre-promised for a largest coding unit or a smallest codingunit. For example, the image decoding apparatus 100 may determine thatthe pre-promised split shape mode information for the largest codingunit indicates quad splitting. Also, the image decoding apparatus 100may determine that the pre-promised split shape mode information for thesmallest coding unit indicates “not to perform splitting”. For example,the image decoding apparatus 100 may determine a size of the largestcoding unit to be 256×256. The image decoding apparatus 100 maydetermine that the pre-promised split shape mode information indicatesquad splitting. The quad splitting is a split shape mode in which thewidth and the height of the coding unit are halved. The image decodingapparatus 100 may obtain the coding unit having a size of 128×128 fromthe largest coding unit having a size of 256×256 based on the splitshape mode information. Also, the image decoding apparatus 100 maydetermine a size of the smallest coding unit to be 4×4. The imagedecoding apparatus 100 may obtain the split shape mode informationindicating “not to perform splitting” for the smallest coding unit.

According to an embodiment, the image decoding apparatus 100 may use theblock shape information indicating that the current coding unit has asquare shape. For example, the image decoding apparatus 100 maydetermine whether not to split a square coding unit, whether tovertically split the square coding unit, whether to horizontally splitthe square coding unit, or whether to split the square coding unit intofour coding units, based on the split shape mode information. Referringto FIG. 3, when the block shape information of a current coding unit 300indicates a square shape, the decoder 120 may determine that a codingunit 310 a having the same size as the current coding unit 300 is notsplit, based on the split shape mode information indicating not toperform splitting, or may determine coding units 310 b, 310 c, 310 d,310 e, and 310 f split based on the split shape mode informationindicating a predetermined splitting method.

Referring to FIG. 3, according to an embodiment, the image decodingapparatus 100 may determine two coding units 310 b obtained byvertically splitting the current coding unit 300, based on the splitshape mode information indicating to vertically perform splitting. Theimage decoding apparatus 100 may determine two coding units 310 cobtained by horizontally splitting the current coding unit 300, based onthe split shape mode information indicating to horizontally performsplitting. The image decoding apparatus 100 may determine four codingunits 310 d obtained by vertically and horizontally splitting thecurrent coding unit 300, based on the split shape mode informationindicating to vertically and horizontally perform splitting. The imagedecoding apparatus 100 may determine three coding units 310 e obtainedby vertically splitting the current coding unit 300, based on the splitshape mode information indicating to vertically perform ternarysplitting according to an embodiment. The image decoding apparatus 100may determine three coding units 310 f obtained by horizontallysplitting the current coding unit 300, based on the split shape modeinformation indicating to horizontally perform ternary splitting.However, splitting methods of the square coding unit are not limited tothe above-described methods, and the split shape mode information mayinclude various methods. Predetermined splitting methods of splittingthe square coding unit will be described in detail below through variousembodiments.

FIG. 4 illustrates a process, performed by the image decoding apparatus100, of determining at least one coding unit by splitting a non-squarecoding unit, according to an embodiment.

According to an embodiment, the image decoding apparatus 100 may useblock shape information indicating that a current coding unit has anon-square shape. The image decoding apparatus 100 may determine,according to split shape mode information, whether not to split thenon-square current coding unit or whether to split the non-squarecurrent coding unit by using a predetermined method. Referring to FIG.4, when the block shape information of a current coding unit 400 or 450indicates a non-square shape, the image decoding apparatus 100 maydetermine a coding unit 410 or 460 having the same size as the currentcoding unit 400 or 450 based on the split shape mode informationindicating not to perform splitting, or determine coding units 420 a and420 b, 430 a to 430 c, 470 a and 470 b, or 480 a to 480 c split based onthe split shape mode information indicating a predetermined splittingmethod. Predetermined splitting methods of splitting a non-square codingunit will be described in detail below through various embodiments.

According to an embodiment, the image decoding apparatus 100 maydetermine a splitting method of a coding unit by using the split shapemode information and, in this case, the split shape mode information mayindicate the number of one or more coding units generated by splittingthe coding unit. Referring to FIG. 4, when the split shape modeinformation indicates to split the current coding unit 400 or 450 intotwo coding units, the image decoding apparatus 100 may determine twocoding units 420 a and 420 b, or 470 a and 470 b included in the currentcoding unit 400 or 450 by splitting the current coding unit 400 or 450based on the split shape mode information.

According to an embodiment, when the image decoding apparatus 100 splitsthe non-square current coding unit 400 or 450 based on the split shapemode information, the location of a long side of the non-square currentcoding unit 400 or 450 may be considered. For example, the imagedecoding apparatus 100 may determine a plurality of coding units bysplitting the long side of the current coding unit 400 or 450, inconsideration of the shape of the current coding unit 400 or 450.

According to an embodiment, when the split shape mode informationindicates to split (ternary split) a coding unit into an odd number ofblocks, the image decoding apparatus 100 may determine an odd number ofcoding units included in the current coding unit 400 or 450. Forexample, when the split shape mode information indicates to split thecurrent coding unit 400 or 450 into three coding units, the imagedecoding apparatus 100 may split the current coding unit 400 or 450 intothree coding units 430 a, 430 b, and 430 c, or 480 a, 480 b, and 480 c.

According to an embodiment, a ratio between a width and a height of thecurrent coding unit 400 or 450 may be 4:1 or 1:4. When the ratio betweenthe width and the height is 4:1, a length of the width is greater than alength of the height, and thus the block shape information may behorizontal. When the ratio between the width and the height is 1:4, alength of the width is less than a length of the height, and thus theblock shape information may be vertical. The image decoding apparatus100 may determine to split the current coding unit into an odd number ofblocks based on the split shape mode information. Also, the imagedecoding apparatus 100 may determine a split direction of the currentcoding unit 400 or 450 based on the block shape information of thecurrent coding unit 400 or 450. For example, when the current codingunit 400 is in a vertical direction, the image decoding apparatus 100may horizontally split the current coding unit 400 and may determine thecoding units 430 a, 430 b, and 430 c. Also, when the current coding unit450 is in a horizontal direction, the image decoding apparatus 100 mayvertically split the current coding unit 450 and may determine thecoding units 480 a, 480 b, and 480 c.

According to an embodiment, the image decoding apparatus 100 maydetermine an odd number of coding units included in the current codingunit 400 or 450, and sizes of all of the determined coding units may notbe the same. For example, a predetermined coding unit 430 b or 480 bfrom among the determined odd number of coding units 430 a, 430 b, and430 c, or 480 a, 480 b, and 480 c may have a size different from sizesof the other coding units 430 a and 430 c, or 480 a and 480 c. That is,coding units which may be determined by splitting the current codingunit 400 or 450 may have multiple sizes and, in some cases, all of theodd number of coding units 430 a, 430 b, and 430 c, or 480 a, 480 b, and480 c may have different sizes.

According to an embodiment, when the split shape mode informationindicates to split a coding unit into an odd number of blocks, the imagedecoding apparatus 100 may determine an odd number of coding unitsincluded in the current coding unit 400 or 450, and may put apredetermined restriction on at least one coding unit from among the oddnumber of coding units generated by splitting the current coding unit400 or 450. Referring to FIG. 4, the image decoding apparatus 100 mayallow a decoding method of the coding unit 430 b or 480 b to bedifferent from that of the other coding units 430 a and 430 c, or 480 aand 480 c, wherein the coding unit 430 b or 480 b is at a centerlocation from among the three coding units 430 a, 430 b, and 430 c, or480 a, 480 b, and 480 c generated by splitting the current coding unit400 or 450. For example, the image decoding apparatus 100 may restrictthe coding unit 430 b or 480 b at the center location to be no longersplit or to be split only a predetermined number of times, unlike theother coding units 430 a and 430 c, or 480 a and 480 c.

FIG. 5 illustrates a process, performed by the image decoding apparatus100, of splitting a coding unit based on at least one of block shapeinformation and split shape mode information, according to anembodiment.

According to an embodiment, the image decoding apparatus 100 maydetermine to split or not to split a square first coding unit 500 intocoding units based on at least one of the block shape information andthe split shape mode information. According to an embodiment, when thesplit shape mode information indicates to split the first coding unit500 in a horizontal direction, the image decoding apparatus 100 maydetermine a second coding unit 510 by splitting the first coding unit500 in a horizontal direction. A first coding unit, a second codingunit, and a third coding unit used according to an embodiment are termsused to understand a relation before and after splitting a coding unit.For example, the second coding unit may be determined by splitting thefirst coding unit, and the third coding unit may be determined bysplitting the second coding unit. It will be understood that arelationship among the first coding unit, the second coding unit, andthe third coding unit applies to the following descriptions.

According to an embodiment, the image decoding apparatus 100 maydetermine to split or not to split the determined second coding unit 510into coding units, based on the split shape mode information. Referringto FIG. 5, the image decoding apparatus 100 may or may not split thenon-square second coding unit 510, which is determined by splitting thefirst coding unit 500, into one or more third coding units 520 a, or 520b, 520 c, and 520 d based on the split shape mode information. The imagedecoding apparatus 100 may obtain the split shape mode information, andmay split a plurality of various-shaped second coding units (e.g., 510)by splitting the first coding unit 500, based on the obtained splitshape mode information, and the second coding unit 510 may be split byusing a splitting method of the first coding unit 500 based on the splitshape mode information. According to an embodiment, when the firstcoding unit 500 is split into the second coding units 510 based on thesplit shape mode information of the first coding unit 500, the secondcoding unit 510 may also be split into the third coding units 520 a, or520 b, 520 c, and 520 d based on the split shape mode information of thesecond coding unit 510. That is, a coding unit may be recursively splitbased on the split shape mode information of each coding unit.Therefore, a square coding unit may be determined by splitting anon-square coding unit, and a non-square coding unit may be determinedby recursively splitting the square coding unit.

Referring to FIG. 5, a predetermined coding unit (e.g., a coding unit ata center location or a square coding unit) from among an odd number ofthird coding units 520 b, 520 c, and 520 d determined by splitting thenon-square second coding unit 510 may be recursively split. According toan embodiment, the square third coding unit 520 b from among the oddnumber of third coding units 520 b, 520 c, and 520 d may be split in ahorizontal direction into a plurality of fourth coding units. Anon-square fourth coding unit 530 b or 530 d from among the plurality offourth coding units 530 a, 530 b, 530 c, and 530 d may be split againinto a plurality of coding units. For example, the non-square fourthcoding unit 530 b or 530 d may be split again into an odd number ofcoding units, A method that may be used to recursively split a codingunit will be described below through various embodiments.

According to an embodiment, the image decoding apparatus 100 may spliteach of the third coding units 520 a, or 520 b, 520 c, and 520 d intocoding units, based on the split shape mode information. Also, the imagedecoding apparatus 100 may determine not to split the second coding unit510 based on the split shape mode information. According to anembodiment, the image decoding apparatus 100 may split the non-squaresecond coding unit 510 into the odd number of third coding units 520 b,520 c, and 520 d. The image decoding apparatus 100 may put apredetermined restriction on a predetermined third coding unit fromamong the odd number of third coding units 520 b, 520 c, and 520 d. Forexample, the image decoding apparatus 100 may restrict the third codingunit 520 c at a center location from among the odd number of thirdcoding units 520 b, 520 c, and 520 d to be no longer split or to besplit a settable number of times.

Referring to FIG. 5, the image decoding apparatus 100 may restrict thethird coding unit 520 c, which is at the center location from among theodd number of third coding units 520 b, 520 c, and 520 d included in thenon-square second coding unit 510, to be no longer split, to be split byusing a predetermined splitting method (e.g., split into only fourcoding units or split by using a splitting method of the second codingunit 510), or to be split only a predetermined number of times (e.g.,split only n times (where n>0)). However, the restrictions on the thirdcoding unit 520 c at the center location are not limited to theabove-described examples, and may include various restrictions fordecoding the third coding unit 520 c at the center location differentlyfrom the other third coding units 520 b and 520 d.

According to an embodiment, the image decoding apparatus 100 may obtainthe split shape mode information, which is used to split a currentcoding unit, from a predetermined location in the current coding unit.

FIG. 6 illustrates a method, performed by the image decoding apparatus100, of determining a predetermined coding unit from among an odd numberof coding units, according to an embodiment.

Referring to FIG. 6, split shape mode information of a current codingunit 600 or 650 may be obtained from a sample of a predeterminedlocation (e.g., a sample 640 or 690 of a center location) from among aplurality of samples included in the current coding unit 600 or 650.However, the predetermined location in the current coding unit 600, fromwhich at least one of the split shape mode information may be obtained,is not limited to the center location in FIG. 6, and may include variouslocations (e.g., top, bottom, left, right, top left, bottom left, topright, and bottom right locations) included in the current coding unit600. The image decoding apparatus 100 may obtain the split shape modeinformation from the predetermined location and may determine to splitor not to split the current coding unit into various-shaped andvarious-sized coding units.

According to an embodiment, when the current coding unit is split into apredetermined number of coding units, the image decoding apparatus 100may select one of the coding units. Various methods that may be used toselect one of a plurality of coding units will be described belowthrough various embodiments.

According to an embodiment, the image decoding apparatus 100 may splitthe current coding unit into a plurality of coding units, and maydetermine a coding unit at a predetermined location.

According to an embodiment, the image decoding apparatus 100 may useinformation indicating locations of an odd number of coding units todetermine a coding unit at a center location from among the odd numberof coding units. Referring to FIG. 6, the image decoding apparatus 100may determine an odd number of coding units 620 a, 620 b, and 620 c oran odd number of coding units 660 a, 660 b, and 660 c by splitting thecurrent coding unit 600 or the current coding unit 650. The imagedecoding apparatus 100 may determine the coding unit 620 b at a centerlocation or the coding unit 660 b at a center location by usinginformation about locations of the odd number of coding units 620 a, 620b, and 620 c or the odd number of coding units 660 a, 660 b, and 660 c.For example, the image decoding apparatus 100 may determine the codingunit 620 b of the center location by determining the locations of thecoding units 620 a, 620 b, and 620 c based on information indicatinglocations of predetermined samples included in the coding units 620 a,620 b, and 620 c. In detail, the image decoding apparatus 100 maydetermine the coding unit 620 b at the center location by determiningthe locations of the coding units 620 a, 620 b, and 620 c based oninformation indicating locations of top left samples 630 a, 630 b, and630 c of the coding units 620 a, 620 b, and 620 c.

According to an embodiment, the information indicating the locations ofthe top left samples 630 a, 630 b, and 630 c, which are included in thecoding units 620 a, 620 b, and 620 c, respectively, may includeinformation about locations or coordinates of the coding units 620 a,620 b, and 620 c in a picture. According to an embodiment, theinformation indicating the locations of the top left samples 630 a, 630b, and 630 c, which are included in the coding units 620 a, 620 b, and620 c, respectively, may include information indicating widths orheights of the coding units 620 a, 620 b, and 620 c included in thecurrent coding unit 600, and the widths or heights may correspond toinformation indicating differences between the coordinates of the codingunits 620 a, 620 b, and 620 c in the picture. That is, the imagedecoding apparatus 100 may determine the coding unit 620 b at the centerlocation by directly using the information about the locations orcoordinates of the coding units 620 a, 620 b, and 620 c in the picture,or by using the information about the widths or heights of the codingunits, which correspond to the difference values between thecoordinates.

According to an embodiment, information indicating the location of thetop left sample 630 a of the upper coding unit 620 a may includecoordinates (xa, ya), information indicating the location of the topleft sample 630 b of the middle coding unit 620 b may includecoordinates (xb, yb), and information indicating the location of the topleft sample 630 c of the lower coding unit 620 c may include coordinates(xc, yc). The image decoding apparatus 100 may determine the middlecoding unit 620 b by using the coordinates of the top left samples 630a, 630 b, and 630 c which are included in the coding units 620 a, 620 b,and 620 c, respectively. For example, when the coordinates of the topleft samples 630 a, 630 b, and 630 c are sorted in an ascending ordescending order, the coding unit 620 b including the coordinates (xb,yb) of the sample 630 b at a center location may be determined as acoding unit at a center location from among the coding units 620 a, 620b, and 620 c determined by splitting the current coding unit 600.However, the coordinates indicating the locations of the top leftsamples 630 a, 630 b, and 630 c may include coordinates indicatingabsolute locations in the picture, or may use coordinates (dxb, dyb)indicating a relative location of the top left sample 630 b of themiddle coding unit 620 b and coordinates (dxc, dyc) indicating arelative location of the top left sample 630 c of the lower coding unit620 c, with reference to the location of the top left sample 630 a ofthe upper coding unit 620 a. Also, a method of determining a coding unitat a predetermined location by using coordinates of a sample included inthe coding unit as information indicating a location of the sample isnot limited to the above-described method, and may include variousarithmetic methods capable of using the coordinates of the sample.

According to an embodiment, the image decoding apparatus 100 may splitthe current coding unit 600 into the plurality of coding units 620 a,620 b, and 620 c, and may select one of the coding units 620 a, 620 b,and 620 c based on a predetermined criterion. For example, the imagedecoding apparatus 100 may select the coding unit 620 b, which has asize different from that of the others, from among the coding units 620a, 620 b, and 620 c.

According to an embodiment, the image decoding apparatus 100 maydetermine the widths or heights of the coding units 620 a, 620 b, and620 c by using the coordinates (xa, ya) indicating the location of thetop left sample 630 a of the upper coding unit 620 a, the coordinates(xb, yb) indicating the location of the top left sample 630 b of themiddle coding unit 620 b, and the coordinates (xc, yc) indicating thelocation of the top left sample 630 c of the lower coding unit 620 c.The image decoding apparatus 100 may determine the respective sizes ofthe coding units 620 a, 620 b, and 620 c by using the coordinates (xa,ya), (xb, yb), and (xc, yc) indicating the locations of the coding units620 a, 620 b, and 620 c. According to an embodiment, the image decodingapparatus 100 may determine the width of the upper coding unit 620 a tobe a width of the current coding unit 600. The image decoding apparatus100 may determine the height of the upper coding unit 620 a to be yb-ya.According to an embodiment, the image decoding apparatus 100 maydetermine the width of the middle coding unit 620 b to be a width of thecurrent coding unit 600. The image decoding apparatus 100 may determinethe height of the middle coding unit 620 b to be yc-yb. According to anembodiment, the image decoding apparatus 100 may determine the width orheight of the lower coding unit 620 c by using the width or height ofthe current coding unit 600 and the widths or heights of the upper andmiddle coding units 620 a and 620 b. The image decoding apparatus 100may determine a coding unit, which has a size different from that of theothers, based on the determined widths and heights of the coding units620 a to 620 c. Referring to FIG. 6, the image decoding apparatus 100may determine the middle coding unit 620 b, which has a size differentfrom the size of the upper and lower coding units 620 a and 620 c, asthe coding unit of the predetermined location. However, theabove-described method, performed by the image decoding apparatus 100,of determining a coding unit having a size different from the size ofthe other coding units merely corresponds to an example of determining acoding unit at a predetermined location by using the sizes of codingunits, which are determined based on coordinates of samples, and thusvarious methods of determining a coding unit at a predetermined locationby comparing the sizes of coding units, which are determined based oncoordinates of predetermined samples, may be used.

The image decoding apparatus 100 may determine a width or a height ofeach of the coding units 660 a, 660 b, and 660 c by using coordinates(xd, yd) that are information indicating a location of a top left sample670 a of the left coding unit 660 a, coordinates (xe, ye) that areinformation indicating a location of a top left sample 670 b of themiddle coding unit 660 b, and coordinates (xf, yf) that are informationindicating a location of a top left sample 670 c of the right codingunit 660 c. The image decoding apparatus 100 may determine sizes of thecoding units 660 a, 660 b, and 660 c by using the coordinates (xd, yd),(xe, ye), and (xf, yf) indicating the locations of the coding units 660a, 660 b, and 660 c.

According to an embodiment, the image decoding apparatus 100 maydetermine the width of the left coding unit 660 a to be xe-xd. The imagedecoding apparatus 100 may determine the height of the left coding unit660 a as the height of the current coding unit 650. According to anembodiment, the image decoding apparatus 100 may determine the width ofthe middle coding unit 660 b to be xf-xe. The image decoding apparatus100 may determine the height of the middle coding unit 660 b to be theheight of the current coding unit 600. According to an embodiment, theimage decoding apparatus 100 may determine the width or the height ofthe right coding unit 660 c by using the width or the height of thecurrent coding unit 650 and the width and the height of the left codingunit 660 a and the middle coding unit 660 b. The image decodingapparatus 100 may determine a coding unit, which has a size differentfrom that of the others, based on the determined widths and heights ofthe coding units 660 a, 660 b, and 660 c. Referring to FIG. 6, the imagedecoding apparatus 100 may determine the middle coding unit 660 b, whichhas a size different from the size of the left coding unit 660 a and theright coding unit 660 c, as the coding unit of the predeterminedlocation. However, the above-described method, performed by the imagedecoding apparatus 100, of determining a coding unit having a sizedifferent from the size of the other coding units merely corresponds toan example of determining a coding unit at a predetermined location byusing the sizes of coding units, which are determined based oncoordinates of samples, and thus various methods of determining a codingunit at a predetermined location by comparing the sizes of coding units,which are determined based on coordinates of predetermined samples, maybe used.

However, locations of samples considered to determine locations ofcoding units are not limited to the above-described top left locations,and information about arbitrary locations of samples included in thecoding units may be used.

According to an embodiment, the image decoding apparatus 100 may selecta coding unit at a predetermined location from among an odd number ofcoding units determined by splitting the current coding unit,considering the shape of the current coding unit. For example, when thecurrent coding unit has a non-square shape, a width of which is longerthan a height, the image decoding apparatus 100 may determine the codingunit at the predetermined location in a horizontal direction. That is,the image decoding apparatus 100 may determine one of coding units atdifferent locations in a horizontal direction and may put a restrictionon the coding unit. When the current coding unit has a non-square shape,a height of which is longer than a width, the image decoding apparatus100 may determine the coding unit at the predetermined location in avertical direction. That is, the image decoding apparatus 100 maydetermine one of coding units at different locations in a verticaldirection and may put a restriction on the coding unit.

According to an embodiment, the image decoding apparatus 100 may useinformation indicating respective locations of an even number of codingunits, to determine the coding unit at the predetermined location fromamong the even number of coding units. The image decoding apparatus 100may determine an even number of coding units by splitting (binarysplitting) the current coding unit, and may determine the coding unit atthe predetermined location by using the information about the locationsof the even number of coding units. An operation related thereto maycorrespond to the operation of determining a coding unit at apredetermined location (e.g., a center location) from among an oddnumber of coding units, which has been described in detail above withreference to FIG. 6, and thus detailed descriptions thereof are notprovided here.

According to an embodiment, when a non-square current coding unit issplit into a plurality of coding units, predetermined information abouta coding unit at a predetermined location may be used in a splittingoperation to determine the coding unit at the predetermined locationfrom among the plurality of coding units. For example, the imagedecoding apparatus 100 may use at least one of block shape informationand split shape mode information, which is stored in a sample includedin a coding unit at a center location, in a splitting operation todetermine the coding unit at the center location from among theplurality of coding units determined by splitting the current codingunit.

Referring to FIG. 6, the image decoding apparatus 100 may split thecurrent coding unit 600 into the plurality of coding units 620 a, 620 b,and 620 c based on the split shape mode information, and may determinethe coding unit 620 b at a center location from among the plurality ofthe coding units 620 a, 620 b, and 620 c. Furthermore, the imagedecoding apparatus 100 may determine the coding unit 620 b at the centerlocation, in consideration of a location from which the split shape modeinformation is obtained. That is, the split shape mode information ofthe current coding unit 600 may be obtained from the sample 640 at acenter location of the current coding unit 600 and, when the currentcoding unit 600 is split into the plurality of coding units 620 a, 620b, and 620 c based on the split shape mode information, the coding unit620 b including the sample 640 may be determined as the coding unit atthe center location. However, information used to determine the codingunit at the center location is not limited to the split shape modeinformation, and various kinds of information may be used to determinethe coding unit at the center location.

According to an embodiment, predetermined information for identifyingthe coding unit at the predetermined location may be obtained from apredetermined sample included in a coding unit to be determined.Referring to FIG. 6, the image decoding apparatus 100 may use the splitshape mode information, which is obtained from a sample at apredetermined location in the current coding unit 600 (e.g., a sample ata center location of the current coding unit 600) to determine a codingunit at a predetermined location from among the plurality of the codingunits 620 a, 620 b, and 620 c determined by splitting the current codingunit 600 (e.g., a coding unit at a center location from among aplurality of split coding units). That is, the image decoding apparatus100 may determine the sample at the predetermined location byconsidering a block shape of the current coding unit 600, may determinethe coding unit 620 b including a sample, from which predeterminedinformation (e.g., the split shape mode information) may be obtained,from among the plurality of coding units 620 a, 620 b, and 620 cdetermined by splitting the current coding unit 600, and may put apredetermined restriction on the coding unit 620 b. Referring to FIG. 6,according to an embodiment, the image decoding apparatus 100 maydetermine the sample 640 at the center location of the current codingunit 600 as the sample from which the predetermined information may beobtained, and may put a predetermined restriction on the coding unit 620b including the sample 640, in a decoding operation. However, thelocation of the sample from which the predetermined information may beobtained is not limited to the above-described location, and may includearbitrary locations of samples included in the coding unit 620 b to bedetermined for a restriction.

According to an embodiment, the location of the sample from which thepredetermined information may be obtained may be determined based on theshape of the current coding unit 600. According to an embodiment, theblock shape information may indicate whether the current coding unit hasa square or non-square shape, and the location of the sample from whichthe predetermined information may be obtained may be determined based onthe shape. For example, the image decoding apparatus 100 may determine asample located on a boundary for dividing at least one of a width andheight of the current coding unit in half, as the sample from which thepredetermined information may be obtained, by using at least one ofinformation about the width of the current coding unit and informationabout the height of the current coding unit. As another example, whenthe block shape information of the current coding unit indicates anon-square shape, the image decoding apparatus 100 may determine one ofsamples adjacent to a boundary for dividing a long side of the currentcoding unit in half, as the sample from which the predeterminedinformation may be obtained.

According to an embodiment, when the current coding unit is split into aplurality of coding units, the image decoding apparatus 100 may use thesplit shape mode information to determine a coding unit at apredetermined location from among the plurality of coding units.According to an embodiment, the image decoding apparatus 100 may obtainthe split shape mode information from a sample at a predeterminedlocation in a coding unit, and may split the plurality of coding units,which are generated by splitting the current coding unit, by using thesplit shape mode information, which is obtained from the sample of thepredetermined location in each of the plurality of coding units. Thatis, a coding unit may be recursively split based on the split shape modeinformation, which is obtained from the sample at the predeterminedlocation in each coding unit. An operation of recursively splitting acoding unit has been described above with reference to FIG. 5, and thusdetailed descriptions thereof will not be provided here.

According to an embodiment, the image decoding apparatus 100 maydetermine one or more coding units by splitting the current coding unit,and may determine an order of decoding the one or more coding unitsbased on a predetermined block (e.g., the current coding unit).

FIG. 7 illustrates an order of processing a plurality of coding unitswhen the image decoding apparatus 100 determines the plurality of codingunits by splitting a current coding unit, according to an embodiment.

According to an embodiment, the image decoding apparatus 100 maydetermine second coding units 710 a and 710 b by splitting a firstcoding unit 700 in a vertical direction, may determine second codingunits 730 a and 730 b by splitting the first coding unit 700 in ahorizontal direction, or may determine second coding units 750 a to 750d by splitting the first coding unit 700 in vertical and horizontaldirections, based on split shape mode information.

Referring to FIG. 7, the image decoding apparatus 100 may determine toprocess the second coding units 710 a and 710 b, which are determined bysplitting the first coding unit 700 in a vertical direction, in ahorizontal direction order 710 c. The image decoding apparatus 100 maydetermine to process the second coding units 730 a and 730 b, which aredetermined by splitting the first coding unit 1400 in a horizontaldirection, in a vertical direction order 730 c. The image decodingapparatus 100 may determine to process the second coding units 750 a to750 d, which are determined by splitting the first coding unit 700 invertical and horizontal directions, in a predetermined order forprocessing coding units in a row and then processing coding units in anext row (e.g., in a raster scan order or Z-scan order 750 e).

According to an embodiment, the image decoding apparatus 100 mayrecursively split coding units. Referring to FIG. 7, the image decodingapparatus 100 may determine the plurality of second coding units 710 a,710 b, 730 a, 730 b, 750 a, 750 b, 750 c, and 750 d by splitting thefirst coding unit 700, and may recursively split each of the determinedplurality of second coding units 710 a, 710 b, 730 a, 730 b, 750 a, 750b, 750 c, and 750 d. A splitting method of the plurality of secondcoding units 710 a, 710 b, 730 a, 730 b, 750 a, 750 b, 750 c, and 750 dmay correspond to a splitting method of the first coding unit 700. Assuch, each of the plurality of second coding units 710 a, 710 b, 730 a,730 b, 750 a, 750 b, 750 c, and 750 d may be independently split into aplurality of coding units. Referring to FIG. 7, the image decodingapparatus 100 may determine the second coding units 710 a and 710 b bysplitting the first coding unit 700 in a vertical direction, and maydetermine to independently split or not to split each of the secondcoding units 710 a and 710 b.

According to an embodiment, the image decoding apparatus 100 maydetermine third coding units 720 a and 720 b by splitting the leftsecond coding unit 710 a in a horizontal direction, and may not splitthe right second coding unit 710 b.

According to an embodiment, a processing order of coding units may bedetermined based on an operation of splitting a coding unit. In otherwords, a processing order of split coding units may be determined basedon a processing order of coding units immediately before being split.The image decoding apparatus 100 may determine a processing order of thethird coding units 720 a and 720 b determined by splitting the leftsecond coding unit 710 a, independently of the right second coding unit710 b. Because the third coding units 720 a and 720 b are determined bysplitting the left second coding unit 710 a in a horizontal direction,the third coding units 720 a and 720 b may be processed in a verticaldirection order 720 c. Because the left and right second coding units710 a and 710 b are processed in the horizontal direction order 710 c,the right second coding unit 710 b may be processed after the thirdcoding units 720 a and 720 b included in the left second coding unit 710a are processed in the vertical direction order 720 c. An operation ofdetermining a processing order of coding units based on a coding unitbefore being split is not limited to the above-described example, andvarious methods may be used to independently process coding units, whichare split and determined to various shapes, in a predetermined order.

FIG. 8 illustrates a process, performed by the image decoding apparatus100, of determining that a current coding unit is to be split into anodd number of coding units, when the coding units are not processable ina predetermined order, according to an embodiment.

According to an embodiment, the image decoding apparatus 100 maydetermine whether the current coding unit is split into an odd number ofcoding units, based on obtained split shape mode information. Referringto FIG. 8, a square first coding unit 800 may be split into non-squaresecond coding units 810 a and 810 b, and the second coding units 810 aand 810 b may be independently split into third coding units 820 a and820 b, and 820 c to 820 e. According to an embodiment, the imagedecoding apparatus 100 may determine the plurality of third coding units820 a and 820 b by splitting the left second coding unit 810 a in ahorizontal direction, and may split the right second coding unit 810 binto an odd number of third coding units 820 c to 820 e.

According to an embodiment, the image decoding apparatus 100 maydetermine whether any coding unit is split into an odd number of codingunits, by determining whether the third coding units 820 a and 820 b,and 820 c to 820 e are processable in a predetermined order. Referringto FIG. 8, the image decoding apparatus 100 may determine the thirdcoding units 820 a and 820 b, and 820 c to 820 e by recursivelysplitting the first coding unit 800. The image decoding apparatus 100may determine whether any of the first coding unit 800, the secondcoding units 810 a and 810 b, and the third coding units 820 a and 820b, and 820 c, 820 d, and 820 e is split into an odd number of codingunits, based on at least one of block shape information and split shapemode information. For example, the right second coding unit 810 b may besplit into an odd number of third coding units 820 c, 820 d, and 820 e.A processing order of a plurality of coding units included in the firstcoding unit 800 may be a predetermined order (e.g., a Z-scan order 830),and the image decoding apparatus 100 may decide whether the third codingunits 820 c, 820 d, and 820 e, which are determined by splitting theright second coding unit 810 b into an odd number of coding units,satisfy a condition for processing in the predetermined order.

According to an embodiment, the image decoding apparatus 100 maydetermine whether the third coding units 820 a and 820 b, and 820 c, 820d, and 820 e included in the first coding unit 800 satisfy the conditionfor processing in the predetermined order, and the condition relates towhether at least one of a width and height of the second coding units810 a and 810 b is divided in half along a boundary of the third codingunits 820 a and 820 b, and 820 c, 820 d, and 820 e. For example, thethird coding units 820 a and 820 b determined by dividing the height ofthe non-square left second coding unit 810 a in half may satisfy thecondition. However, because boundaries of the third coding units 820 c,820 d, and 820 e determined by splitting the right second coding unit810 b into three coding units do not divide the width or height of theright second coding unit 810 b in half, it may be determined that thethird coding units 820 c, 820 d, and 820 e do not satisfy the condition.When the condition is not satisfied as described above, the imagedecoding apparatus 100 may decide disconnection of a scan order, anddetermine that the right second coding unit 810 b is split into an oddnumber of coding units, based on a result of the decision. According toan embodiment, when a coding unit is split into an odd number of codingunits, the image decoding apparatus 100 may put a predeterminedrestriction on a coding unit at a predetermined location among the splitcoding units, and the restriction or the predetermined location has beendescribed above through various embodiments and thus detaileddescriptions thereof will not be provided here.

FIG. 9 illustrates a process, performed by the image decoding apparatus100, of determining at least one coding unit by splitting a first codingunit 900, according to an embodiment.

According to an embodiment, the image decoding apparatus 100 may splitthe first coding unit 900, based on split shape mode information, whichis obtained by the bitstream obtainer 110. The square first coding unit900 may be split into four square coding units, or may be split into aplurality of non-square coding units. For example, referring to FIG. 9,when the first coding unit 900 has a square shape and the split shapemode information indicates to split the first coding unit 900 intonon-square coding units, the image decoding apparatus 100 may split thefirst coding unit 900 into a plurality of non-square coding units. Indetail, when the split shape mode information indicates to determine anodd number of coding units by splitting the first coding unit 900 in ahorizontal direction or a vertical direction, the image decodingapparatus 100 may split the square first coding unit 900 into an oddnumber of coding units, e.g., second coding units 910 a, 910 b, and 910c determined by splitting the square first coding unit 900 in a verticaldirection or second coding units 920 a, 920 b, and 920 c determined bysplitting the square first coding unit 900 in a horizontal direction.

According to an embodiment, the image decoding apparatus 100 maydetermine whether the second coding units 910 a, 910 b, 910 c, 920 a,920 b, and 920 c included in the first coding unit 900 satisfy acondition for processing in a predetermined order, and the conditionrelates to whether at least one of a width and height of the firstcoding unit 900 is divided in half along a boundary of the second codingunits 910 a, 910 b, 910 c, 920 a, 920 b, and 920 c. Referring to FIG. 9,because boundaries of the second coding units 910 a, 910 b, and 910 cdetermined by splitting the square first coding unit 900 in a verticaldirection do not divide the width of the first coding unit 900 in half,it may be determined that the first coding unit 900 does not satisfy thecondition for processing in the predetermined order. In addition,because boundaries of the second coding units 920 a, 920 b, and 920 cdetermined by splitting the square first coding unit 900 in a horizontaldirection do not divide the width of the first coding unit 900 in half,it may be determined that the first coding unit 900 does not satisfy thecondition for processing in the predetermined order. When the conditionis not satisfied as described above, the image decoding apparatus 100may decide disconnection of a scan order, and may determine that thefirst coding unit 900 is split into an odd number of coding units basedon a result of the decision. According to an embodiment, when a codingunit is split into an odd number of coding units, the image decodingapparatus 100 may put a predetermined restriction on a coding unit at apredetermined location from among the split coding units, and therestriction or the predetermined location has been described abovethrough various embodiments and thus detailed descriptions thereof willnot be provided here.

According to an embodiment, the image decoding apparatus 100 maydetermine various-shaped coding units by splitting a first coding unit.

Referring to FIG. 9, the image decoding apparatus 100 may split thesquare first coding unit 900 or a non-square first coding unit 930 or950 into various-shaped coding units.

FIG. 10 illustrates that a shape into which a second coding unit issplittable by the image decoding apparatus 100 is restricted when asecond coding unit having a non-square shape, which is determined bysplitting a first coding unit 1000, satisfies a predetermined condition,according to an embodiment.

According to an embodiment, the image decoding apparatus 100 maydetermine to split the square first coding unit 1000 into non-squaresecond coding units 1010 a, 1010 b, 1020 a, and 1020 b, based on splitshape mode information, which is obtained by the bitstream obtainer 110.The second coding units 1010 a, 1010 b, 1020 a, and 1020 b may beindependently split. As such, the image decoding apparatus 100 maydetermine to split or not to split the first coding unit 1000 into aplurality of coding units, based on the split shape mode information ofeach of the second coding units 1010 a, 1010 b, 1020 a, and 1020 b.According to an embodiment, the image decoding apparatus 100 maydetermine third coding units 1012 a and 1012 b by splitting thenon-square left second coding unit 1010 a, which is determined bysplitting the first coding unit 1000 in a vertical direction, in ahorizontal direction. However, when the left second coding unit 1010 ais split in a horizontal direction, the image decoding apparatus 100 mayrestrict the right second coding unit 1010 b to not be split in ahorizontal direction in which the left second coding unit 1010 a issplit. When third coding units 1014 a and 1014 b are determined bysplitting the right second coding unit 1010 b in the same direction,because the left and right second coding units 1010 a and 1010 b areindependently split in a horizontal direction, the third coding units1012 a, 1012 b, 1014 a, and 1014 b may be determined. However, this caseserves equally as a case in which the image decoding apparatus 100splits the first coding unit 1000 into four square second coding units1030 a, 1030 b, 1030 c, and 1030 d, based on the split shape modeinformation, and may be inefficient in terms of image decoding.

According to an embodiment, the image decoding apparatus 100 maydetermine third coding units 1022 a, 1022 b, 1024 a, and 1024 b bysplitting the non-square second coding unit 1020 a or 1020 b, which isdetermined by splitting the first coding unit 1000 in a horizontaldirection, in a vertical direction. However, when a second coding unit(e.g., the upper second coding unit 1020 a) is split in a verticaldirection, for the above-described reason, the image decoding apparatus100 may restrict the other second coding unit (e.g., the lower secondcoding unit 1020 b) to not be split in a vertical direction in which theupper second coding unit 1020 a is split.

FIG. 11 illustrates a process, performed by the image decoding apparatus100, of splitting a square coding unit when split shape mode informationindicates that the square coding unit is not to be split into foursquare coding units, according to an embodiment.

According to an embodiment, the image decoding apparatus 100 maydetermine second coding units 1110 a, 1110 b, 1120 a, 1120 b, etc. bysplitting a first coding unit 1100 based on split shape modeinformation. The split shape mode information may include informationabout various methods of splitting a coding unit but, the informationabout various splitting methods may not include information forsplitting a coding unit into four square coding units. According to suchsplit shape mode information, the image decoding apparatus 100 may notsplit the first square coding unit 1100 into four square second codingunits 1130 a, 1130 b, 1130 c, and 1130 d. The image decoding apparatus100 may determine the non-square second coding units 1110 a, 1110 b,1120 a, 1120 b, etc., based on the split shape mode information.

According to an embodiment, the image decoding apparatus 100 mayindependently split the non-square second coding units 1110 a, 1110 b,1120 a, 1120 b, etc. Each of the second coding units 1110 a, 1110 b,1120 a, 1120 b, etc. may be recursively split in a predetermined order,and this splitting method may correspond to a method of splitting thefirst coding unit 1100 based on the split shape mode information.

For example, the image decoding apparatus 100 may determine square thirdcoding units 1112 a and 1112 b by splitting the left second coding unit1110 a in a horizontal direction, and may determine square third codingunits 1114 a and 1114 b by splitting the right second coding unit 1110 bin a horizontal direction. Furthermore, the image decoding apparatus 100may determine square third coding units 1116 a, 1116 b, 1116 c, and 1116d by splitting both of the left and right second coding units 1110 a and1110 b in a horizontal direction. In this case, coding units having thesame shape as the four square second coding units 1130 a, 1130 b, 1130c, and 1130 d split from the first coding unit 1100 may be determined.

As another example, the image decoding apparatus 100 may determinesquare third coding units 1122 a and 1122 b by splitting the uppersecond coding unit 1120 a in a vertical direction, and may determinesquare third coding units 1124 a and 1124 b by splitting the lowersecond coding unit 1120 b in a vertical direction. Furthermore, theimage decoding apparatus 100 may determine square third coding units1126 a, 1126 b, 1126 c, and 1126 d by splitting both of the upper andlower second coding units 1120 a and 1120 b in a vertical direction. Inthis case, coding units having the same shape as the four square secondcoding units 1130 a, 1130 b, 1130 c, and 1130 d split from the firstcoding unit 1100 may be determined.

FIG. 12 illustrates that a processing order between a plurality ofcoding units may be changed depending on a process of splitting a codingunit, according to an embodiment.

According to an embodiment, the image decoding apparatus 100 may split afirst coding unit 1200, based on split shape mode information. When ablock shape is a square shape and the split shape mode informationindicates to split the first coding unit 1200 in at least one ofhorizontal and vertical directions, the image decoding apparatus 100 maydetermine second coding units 1210 a, 1210 b, 1220 a, 1220 b, etc. bysplitting the first coding unit 1200. Referring to FIG. 12, thenon-square second coding units 1210 a, 1210 b, 1220 a, and 1220 bdetermined by splitting the first coding unit 1200 in only a horizontaldirection or vertical direction may be independently split based on thesplit shape mode information of each coding unit. For example, the imagedecoding apparatus 100 may determine third coding units 1216 a, 1216 b,1216 c, and 1216 d by splitting the second coding units 1210 a and 1210b, which are generated by splitting the first coding unit 1200 in avertical direction, in a horizontal direction, and may determine thirdcoding units 1226 a, 1226 b, 1226 c, and 1226 d by splitting the secondcoding units 1220 a and 1220 b, which are generated by splitting thefirst coding unit 1200 in a horizontal direction, in a horizontaldirection. An operation of splitting the second coding units 1210 a,1210 b, 1220 a, and 1220 b has been described above with reference toFIG. 11, and thus detailed descriptions thereof will not be providedhere.

According to an embodiment, the image decoding apparatus 100 may processcoding units in a predetermined order. An operation of processing codingunits in a predetermined order has been described above with referenceto FIG. 7, and thus detailed descriptions thereof will not be providedhere. Referring to FIG. 12, the image decoding apparatus 100 maydetermine four square third coding units 1216 a, 1216 b, 1216 c, and1216 d, and 1226 a, 1226 b, 1226 c, and 1226 d by splitting the squarefirst coding unit 1200. According to an embodiment, the image decodingapparatus 100 may determine processing orders of the third coding units1216 a, 1216 b, 1216 c, and 1216 d, and 1226 a, 1226 b, 1226 c, and 1226d based on a splitting method of the first coding unit 1200.

According to an embodiment, the image decoding apparatus 100 maydetermine the third coding units 1216 a, 1216 b, 1216 c, and 1216 d bysplitting the second coding units 1210 a and 1210 b generated bysplitting the first coding unit 1200 in a vertical direction, in ahorizontal direction, and may process the third coding units 1216 a,1216 b, 1216 c, and 1216 d in a processing order 1217 for initiallyprocessing the third coding units 1216 a and 1216 c, which are includedin the left second coding unit 1210 a, in a vertical direction and thenprocessing the third coding unit 1216 b and 1216 d, which are includedin the right second coding unit 1210 b, in a vertical direction.

According to an embodiment, the image decoding apparatus 100 maydetermine the third coding units 1226 a, 1226 b, 1226 c, and 1226 d bysplitting the second coding units 1220 a and 1220 b generated bysplitting the first coding unit 1200 in a horizontal direction, in avertical direction, and may process the third coding units 1226 a, 1226b, 1226 c, and 1226 d in a processing order 1227 for initiallyprocessing the third coding units 1226 a and 1226 b, which are includedin the upper second coding unit 1220 a, in a horizontal direction andthen processing the third coding unit 1226 c and 1226 d, which areincluded in the lower second coding unit 1220 b, in a horizontaldirection.

Referring to FIG. 12, the square third coding units 1216 a, 1216 b, 1216c, and 1216 d, and 1226 a, 1226 b, 1226 c, and 1226 d may be determinedby splitting the second coding units 1210 a, 1210 b, 1220 a, and 1220 b,respectively. Although the second coding units 1210 a and 1210 b aredetermined by splitting the first coding unit 1200 in a verticaldirection differently from the second coding units 1220 a and 1220 bwhich are determined by splitting the first coding unit 1200 in ahorizontal direction, the third coding units 1216 a, 1216 b, 1216 c, and1216 d, and 1226 a, 1226 b, 1226 c, and 1226 d split therefromeventually show same-shaped coding units split from the first codingunit 1200. As such, by recursively splitting a coding unit in differentmanners based on the split shape mode information, the image decodingapparatus 100 may process a plurality of coding units in differentorders even when the coding units are eventually determined to be thesame shape.

FIG. 13 illustrates a process of determining a depth of a coding unit asa shape and a size of the coding unit change, when the coding unit isrecursively split such that a plurality of coding units are determined,according to an embodiment.

According to an embodiment, the image decoding apparatus 100 maydetermine the depth of the coding unit, based on a predeterminedcriterion. For example, the predetermined criterion may be the length ofa long side of the coding unit. When the length of a long side of acoding unit before being split is 2n times (n>0) the length of a longside of a split current coding unit, the image decoding apparatus 100may determine that a depth of the current coding unit is increased froma depth of the coding unit before being split, by n. In the followingdescription, a coding unit having an increased depth is expressed as acoding unit of a deeper depth.

Referring to FIG. 13, according to an embodiment, the image decodingapparatus 100 may determine a second coding unit 1302, a third codingunit 1304, etc. of deeper depths by splitting a square first coding unit1300 based on block shape information indicating a square shape (e.g.,the block shape information may be expressed as ‘0: SQUARE’). Assumingthat the size of the square first coding unit 1300 is 2N×2N, the secondcoding unit 1302 determined by dividing a width and height of the firstcoding unit 1300 to ½ may have a size of N×N. Furthermore, the thirdcoding unit 1304 determined by dividing a width and height of the secondcoding unit 1302 to ½ may have a size of N/2×N/2. In this case, a widthand height of the third coding unit 1304 are ¼ times those of the firstcoding unit 1300. When a depth of the first coding unit 1300 is D, adepth of the second coding unit 1302, the width and height of which are½ times those of the first coding unit 1300, may be D+1, and a depth ofthe third coding unit 1304, the width and height of which are ¼ timesthose of the first coding unit 1300, may be D+2.

According to an embodiment, the image decoding apparatus 100 maydetermine a second coding unit 1312 or 1322, a third coding unit 1314 or1324, etc. of deeper depths by splitting a non-square first coding unit1310 or 1320 based on block shape information indicating a non-squareshape (e.g., the block shape information may be expressed as ‘1: NS_VER’indicating a non-square shape, a height of which is longer than a width,or as ‘2: NS_HOR’ indicating a non-square shape, a width of which islonger than a height).

The image decoding apparatus 100 may determine the second coding unit1302, 1312, or 1322 by dividing at least one of a width and height ofthe first coding unit 1310 having a size of N×2N. That is, the imagedecoding apparatus 100 may determine the second coding unit 1302 havinga size of N×N or the second coding unit 1322 having a size of N×N/2 bysplitting the first coding unit 1310 in a horizontal direction, or maydetermine the second coding unit 1312 having a size of N/2×N bysplitting the first coding unit 1310 in horizontal and verticaldirections.

According to an embodiment, the image decoding apparatus 100 maydetermine the second coding unit 1302, 1312, or 1322 by dividing atleast one of a width and height of the first coding unit 1320 having asize of 2N×N. That is, the image decoding apparatus 100 may determinethe second coding unit 1302 having a size of N×N or the second codingunit 1312 having a size of N/2×N by splitting the first coding unit 1320in a vertical direction, or may determine the second coding unit 1322having a size of N×N/2 by splitting the first coding unit 1320 inhorizontal and vertical directions.

According to an embodiment, the image decoding apparatus 100 maydetermine the third coding unit 1304, 1314, or 1324 by dividing at leastone of a width and height of the second coding unit 1302 having a sizeof N×N. That is, the image decoding apparatus 100 may determine thethird coding unit 1304 having a size of N/2×N/2, the third coding unit1314 having a size of N/4×N/2, or the third coding unit 1324 having asize of N/2×N/4 by splitting the second coding unit 1302 in vertical andhorizontal directions.

According to an embodiment, the image decoding apparatus 100 maydetermine the third coding unit 1304, 1314, or 1324 by dividing at leastone of a width and height of the second coding unit 1312 having a sizeof N/2×N. That is, the image decoding apparatus 100 may determine thethird coding unit 1304 having a size of N/2×N/2 or the third coding unit1324 having a size of N/2×N/4 by splitting the second coding unit 1312in a horizontal direction, or may determine the third coding unit 1314having a size of N/4×N/2 by splitting the second coding unit 1312 invertical and horizontal directions.

According to an embodiment, the image decoding apparatus 100 maydetermine the third coding unit 1304, 1314, or 1324 by dividing at leastone of a width and height of the second coding unit 1322 having a sizeof N×N/2. That is, the image decoding apparatus 100 may determine thethird coding unit 1304 having a size of N/2×N/2 or the third coding unit1314 having a size of N/4×N/2 by splitting the second coding unit 1322in a vertical direction, or may determine the third coding unit 1324having a size of N/2×N/4 by splitting the second coding unit 1322 invertical and horizontal directions.

According to an embodiment, the image decoding apparatus 100 may splitthe square coding unit 1300, 1302, or 1304 in a horizontal or verticaldirection. For example, the image decoding apparatus 100 may determinethe first coding unit 1310 having a size of N×2N by splitting the firstcoding unit 1300 having a size of 2N×2N in a vertical direction, or maydetermine the first coding unit 1320 having a size of 2N×N by splittingthe first coding unit 1300 in a horizontal direction. According to anembodiment, when a depth is determined based on the length of thelongest side of a coding unit, a depth of a coding unit determined bysplitting the first coding unit 1300 having a size of 2N×2N in ahorizontal or vertical direction may be the same as the depth of thefirst coding unit 1300.

According to an embodiment, a width and height of the third coding unit1314 or 1324 may be ¼ times those of the first coding unit 1310 or 1320.When a depth of the first coding unit 1310 or 1320 is D, a depth of thesecond coding unit 1312 or 1322, the width and height of which are ½times those of the first coding unit 1310 or 1320, may be D+1, and adepth of the third coding unit 1314 or 1324, the width and height ofwhich are ¼ times those of the first coding unit 1310 or 1320, may beD+2.

FIG. 14 illustrates depths that are determinable based on shapes andsizes of coding units, and part indexes (PIDs) that are fordistinguishing the coding units, according to an embodiment.

According to an embodiment, the image decoding apparatus 100 maydetermine various-shaped second coding units by splitting a square firstcoding unit 1400. Referring to FIG. 14, the image decoding apparatus 100may determine second coding units 1402 a and 1402 b, 1404 a and 1404 b,and 1406 a, 1406 b, 1406 c, and 1406 d by splitting the first codingunit 1400 in at least one of vertical and horizontal directions based onsplit shape mode information. That is, the image decoding apparatus 100may determine the second coding units 1402 a and 1402 b, 1404 a and 1404b, and 1406 a, 1406 b, 1406 c, and 1406 d, based on the split shape modeinformation of the first coding unit 1400.

According to an embodiment, a depth of the second coding units 1402 aand 1402 b, 1404 a and 1404 b, and 1406 a, 1406 b, 1406 c, and 1406 d,which are determined based on the split shape mode information of thesquare first coding unit 1400, may be determined based on the length ofa long side thereof. For example, because the length of a side of thesquare first coding unit 1400 equals the length of a long side of thenon-square second coding units 1402 a and 1402 b, and 1404 a and 1404 b,the first coding unit 1400 and the non-square second coding units 1402 aand 1402 b, and 1404 a and 1404 b may have the same depth, e.g., D.However, when the image decoding apparatus 100 splits the first codingunit 1400 into the four square second coding units 1406 a, 1406 b, 1406c, and 1406 d based on the split shape mode information, because thelength of a side of the square second coding units 1406 a, 1406 b, 1406c, and 1406 d is ½ times the length of a side of the first coding unit1400, a depth of the second coding units 1406 a, 1406 b, 1406 c, and1406 d may be D+1 which is deeper than the depth D of the first codingunit 1400 by 1.

According to an embodiment, the image decoding apparatus 100 maydetermine a plurality of second coding units 1412 a and 1412 b, and 1414a, 1414 b, and 1414 c by splitting a first coding unit 1410, a height ofwhich is longer than a width, in a horizontal direction based on thesplit shape mode information. According to an embodiment, the imagedecoding apparatus 100 may determine a plurality of second coding units1422 a and 1422 b, and 1424 a, 1424 b, and 1424 c by splitting a firstcoding unit 1420, a width of which is longer than a height, in avertical direction based on the split shape mode information.

According to an embodiment, a depth of the second coding units 1412 aand 1412 b, 1414 a, 1414 b, and 1414 c, 1422 a and 1422 b, and 1424 a,1424 b, and 1424 c, which are determined based on the split shape modeinformation of the non-square first coding unit 1410 or 1420, may bedetermined based on the length of a long side thereof. For example,because the length of a side of the square second coding units 1412 aand 1412 b is ½ times the length of a long side of the first coding unit1410 having a non-square shape, a height of which is longer than awidth, a depth of the square second coding units 1412 a and 1412 b isD+1 which is deeper than the depth D of the non-square first coding unit1410 by 1.

Furthermore, the image decoding apparatus 100 may split the non-squarefirst coding unit 1410 into an odd number of second coding units 1414 a,1414 b, and 1414 c based on the split shape mode information. The oddnumber of second coding units 1414 a, 1414 b, and 1414 c may include thenon-square second coding units 1414 a and 1414 c and the square secondcoding unit 1414 b. In this case, because the length of a long side ofthe non-square second coding units 1414 a and 1414 c and the length of aside of the square second coding unit 1414 b are ½ times the length of along side of the first coding unit 1410, a depth of the second codingunits 1414 a, 1414 b, and 1414 c may be D+1 which is deeper than thedepth D of the non-square first coding unit 1410 by 1. The imagedecoding apparatus 100 may determine depths of coding units split fromthe first coding unit 1420 having a non-square shape, a width of whichis longer than a height, by using the above-described method ofdetermining depths of coding units split from the first coding unit1410.

According to an embodiment, the image decoding apparatus 100 maydetermine PIDs for identifying split coding units, based on a size ratiobetween the coding units when an odd number of split coding units do nothave equal sizes. Referring to FIG. 14, the coding unit 1414 b of acenter location among the odd number of split coding units 1414 a, 1414b, and 1414 c may have a width equal to that of the other coding units1414 a and 1414 c and a height which is two times that of the othercoding units 1414 a and 1414 c. That is, in this case, the coding unit1414 b at the center location may include two of the other coding unit1414 a or 1414 c. Therefore, when a PID of the coding unit 1414 b at thecenter location is 1 based on a scan order, a PID of the coding unit1414 c located next to the coding unit 1414 b may be increased by 2 andthus may be 3. That is, discontinuity in PID values may be present.According to an embodiment, the image decoding apparatus 100 maydetermine whether an odd number of split coding units do not have equalsizes, based on whether discontinuity is present in PIDs for identifyingthe split coding units.

According to an embodiment, the image decoding apparatus 100 maydetermine whether to use a specific splitting method, based on PIDvalues for identifying a plurality of coding units determined bysplitting a current coding unit. Referring to FIG. 14, the imagedecoding apparatus 100 may determine an even number of coding units 1412a and 1412 b or an odd number of coding units 1414 a, 1414 b, and 1414 cby splitting the first coding unit 1410 having a rectangular shape, aheight of which is longer than a width. The image decoding apparatus 100may use PIDs to identify respective coding units. According to anembodiment, the PID may be obtained from a sample of a predeterminedlocation (e.g., a top left sample) of each coding unit.

According to an embodiment, the image decoding apparatus 100 maydetermine a coding unit at a predetermined location from among the splitcoding units, by using the PIDs for distinguishing the coding units.According to an embodiment, when the split shape mode information of thefirst coding unit 1410 having a rectangular shape, a height of which islonger than a width, indicates to split a coding unit into three codingunits, the image decoding apparatus 100 may split the first coding unit1410 into three coding units 1414 a, 1414 b, and 1414 c. The imagedecoding apparatus 100 may assign a PID to each of the three codingunits 1414 a, 1414 b, and 1414 c. The image decoding apparatus 100 maycompare PIDs of an odd number of split coding units to determine acoding unit at a center location from among the coding units. The imagedecoding apparatus 100 may determine the coding unit 1414 b having a PIDcorresponding to a middle value among the PI Ds of the coding units, asthe coding unit at the center location from among the coding unitsdetermined by splitting the first coding unit 1410. According to anembodiment, the image decoding apparatus 100 may determine PIDs fordistinguishing split coding units, based on a size ratio between thecoding units when the split coding units do not have equal sizes.Referring to FIG. 14, the coding unit 1414 b generated by splitting thefirst coding unit 1410 may have a width equal to that of the othercoding units 1414 a and 1414 c and a height which is two times that ofthe other coding units 1414 a and 1414 c. In this case, when the PID ofthe coding unit 1414 b at the center location is 1, the PID of thecoding unit 1414 c located next to the coding unit 1414 b may beincreased by 2 and thus may be 3. When the PID is not uniformlyincreased as described above, the image decoding apparatus 100 maydetermine that a coding unit is split into a plurality of coding unitsincluding a coding unit having a size different from that of the othercoding units. According to an embodiment, when the split shape modeinformation indicates to split a coding unit into an odd number ofcoding units, the image decoding apparatus 100 may split a currentcoding unit in such a manner that a coding unit of a predeterminedlocation (e.g., a coding unit of a center location) among an odd numberof coding units has a size different from that of the other codingunits. In this case, the image decoding apparatus 100 may determine thecoding unit of the center location, which has a different size, by usingPIDs of the coding units. However, the PID and the size or location ofthe coding unit of the predetermined location to be determined are notlimited to the above-described examples, and various PIDs and variouslocations and sizes of coding units may be used.

According to an embodiment, the image decoding apparatus 100 may use apredetermined data unit where a coding unit starts to be recursivelysplit.

FIG. 15 illustrates that a plurality of coding units are determinedbased on a plurality of predetermined data units included in a picture,according to an embodiment.

According to an embodiment, a predetermined data unit may be defined asa data unit where a coding unit starts to be recursively split by usingsplit shape mode information. That is, the predetermined data unit maycorrespond to a coding unit of an uppermost depth, which is used todetermine a plurality of coding units split from a current picture. Inthe following descriptions, for convenience of explanation, thepredetermined data unit is referred to as a reference data unit.

According to an embodiment, the reference data unit may have apredetermined size and a predetermined shape. According to anembodiment, the reference data unit may include M×N samples. Herein, Mand N may be equal to each other, and may be integers expressed aspowers of 2. That is, the reference data unit may have a square ornon-square shape, and may be split into an integer number of codingunits.

According to an embodiment, the image decoding apparatus 100 may splitthe current picture into a plurality of reference data units. Accordingto an embodiment, the image decoding apparatus 100 may split theplurality of reference data units, which are split from the currentpicture, by using split shape mode information for each reference dataunit. The operation of splitting the reference data unit may correspondto a splitting operation using a quadtree structure.

According to an embodiment, the image decoding apparatus 100 maypreviously determine the minimum size allowed for the reference dataunits included in the current picture. Accordingly, the image decodingapparatus 100 may determine various reference data units having sizesequal to or greater than the minimum size, and may determine one or morecoding units by using the split shape mode information with reference tothe determined reference data unit.

Referring to FIG. 15, the image decoding apparatus 100 may use a squarereference coding unit 1500 or a non-square reference coding unit 1502.According to an embodiment, the shape and size of reference coding unitsmay be determined based on various data units capable of including oneor more reference coding units (e.g., sequences, pictures, slices, slicesegments, largest coding units, or the like).

According to an embodiment, the bitstream obtainer 110 of the imagedecoding apparatus 100 may obtain, from a bitstream, at least one ofreference coding unit shape information and reference coding unit sizeinformation with respect to each of the various data units. An operationof determining one or more coding units included in the square referencecoding unit 1500 has been described above in relation to the operationof splitting the current coding unit 300 of FIG. 3, and an operation ofdetermining one or more coding units included in the non-squarereference coding unit 1502 has been described above in relation to theoperation of splitting the current coding unit 400 or 450 of FIG. 4, andthus, detailed descriptions thereof will not be provided here.

According to an embodiment, the image decoding apparatus 100 may use aPID for identifying the size and shape of reference coding units, todetermine the size and shape of reference coding units according to somedata units previously determined based on a predetermined condition.That is, the bitstream obtainer 110 may obtain, from the bitstream, onlythe PID for identifying the size and shape of reference coding unitswith respect to each slice, slice segment, or largest coding unit whichis a data unit satisfying a predetermined condition (e.g., a data unithaving a size equal to or smaller than a slice) among the various dataunits (e.g., sequences, pictures, slices, slice segments, largest codingunits, or the like). The image decoding apparatus 100 may determine thesize and shape of reference data units with respect to each data unit,which satisfies the predetermined condition, by using the PID. When thereference coding unit shape information and the reference coding unitsize information are obtained and used from the bitstream according toeach data unit having a relatively small size, efficiency of using thebitstream may not be high, and therefore, only the PID may be obtainedand used instead of directly obtaining the reference coding unit shapeinformation and the reference coding unit size information. In thiscase, at least one of the size and shape of reference coding unitscorresponding to the PID for identifying the size and shape of referencecoding units may be previously determined. That is, the image decodingapparatus 100 may determine at least one of the size and shape ofreference coding units included in a data unit serving as a unit forobtaining the PID, by selecting the previously determined at least oneof the size and shape of reference coding units based on the PID.

According to an embodiment, the image decoding apparatus 100 may use oneor more reference coding units included in a largest coding unit. Thatis, a largest coding unit split from a picture may include one or morereference coding units, and coding units may be determined byrecursively splitting each reference coding unit. According to anembodiment, at least one of a width and height of the largest codingunit may be integer times at least one of the width and height of thereference coding units. According to an embodiment, the size ofreference coding units may be obtained by splitting the largest codingunit n times based on a quadtree structure. That is, the image decodingapparatus 100 may determine the reference coding units by splitting thelargest coding unit n times based on a quadtree structure, and may splitthe reference coding unit based on at least one of the block shapeinformation and the split shape mode information according to variousembodiments.

FIG. 16 illustrates a processing block serving as a unit for determininga determination order of reference coding units included in a picture1600, according to an embodiment.

According to an embodiment, the image decoding apparatus 100 maydetermine one or more processing blocks split from a picture. Theprocessing block is a data unit including one or more reference codingunits split from an image, and the one or more reference coding unitsincluded in the processing block may be determined according to aspecific order. That is, a determination order of one or more referencecoding units determined in each processing block may correspond to oneof various types of orders for determining reference coding units, andmay vary depending on the processing block. The determination order ofreference coding units, which is determined with respect to eachprocessing block, may be one of various orders, e.g., raster scan,Z-scan, N-scan, up-right diagonal scan, horizontal scan, and verticalscan, but is not limited to the above-mentioned scan orders.

According to an embodiment, the image decoding apparatus 100 may obtainprocessing block size information and may determine the size of one ormore processing blocks included in the image. The image decodingapparatus 100 may obtain the processing block size information from abitstream and may determine the size of one or more processing blocksincluded in the image. The size of processing blocks may be apredetermined size of data units, which is indicated by the processingblock size information.

According to an embodiment, the bitstream obtainer 110 of the imagedecoding apparatus 100 may obtain the processing block size informationfrom the bitstream according to each specific data unit. For example,the processing block size information may be obtained from the bitstreamin a data unit such as an image, sequence, picture, slice, or slicesegment. That is, bitstream obtainer 110 may obtain the processing blocksize information from the bitstream according to each of the variousdata units, the image decoding apparatus 100 may determine the size ofone or more processing blocks, which are split from the picture, byusing the obtained processing block size information, and the size ofthe processing blocks may be integer times that of the reference codingunits.

According to an embodiment, the image decoding apparatus 100 maydetermine the size of processing blocks 1602 and 1612 included in thepicture 1600. For example, the image decoding apparatus 100 maydetermine the size of processing blocks based on the processing blocksize information obtained from the bitstream. Referring to FIG. 16,according to an embodiment, the image decoding apparatus 100 maydetermine a width of the processing blocks 1602 and 1612 to be fourtimes the width of the reference coding units, and may determine aheight of the processing blocks 1602 and 1612 to be four times theheight of the reference coding units. The image decoding apparatus 100may determine a determination order of one or more reference codingunits in one or more processing blocks.

According to an embodiment, the image decoding apparatus 100 maydetermine the processing blocks 1602 and 1612, which are included in thepicture 1600, based on the size of processing blocks, and may determinea determination order of one or more reference coding units included inthe processing blocks 1602 and 1612. According to an embodiment,determination of reference coding units may include determination of thesize of the reference coding units.

According to an embodiment, the image decoding apparatus 100 may obtain,from the bitstream, determination order information of one or morereference coding units included in one or more processing blocks, andmay determine a determination order with respect to one or morereference coding units based on the obtained determination orderinformation. The determination order information may be defined as anorder or direction for determining the reference coding units in theprocessing block. That is, the determination order of reference codingunits may be independently determined with respect to each processingblock.

According to an embodiment, the image decoding apparatus 100 may obtain,from the bitstream, the determination order information of referencecoding units according to each specific data unit. For example, thebitstream obtainer 110 may obtain the determination order information ofreference coding units from the bitstream according to each data unitsuch as an image, sequence, picture, slice, slice segment, or processingblock. Because the determination order information of reference codingunits indicates an order for determining reference coding units in aprocessing block, the determination order information may be obtainedwith respect to each specific data unit including an integer number ofprocessing blocks.

According to an embodiment, the image decoding apparatus 100 maydetermine one or more reference coding units based on the determineddetermination order.

According to an embodiment, the bitstream obtainer 110 may obtain thedetermination order information of reference coding units from thebitstream as information related to the processing blocks 1602 and 1612,and the image decoding apparatus 100 may determine a determination orderof one or more reference coding units included in the processing blocks1602 and 1612 and determine one or more reference coding units, whichare included in the picture 1600, based on the determination order.Referring to FIG. 16, the image decoding apparatus 100 may determinedetermination orders 1604 and 1614 of one or more reference coding unitsin the processing blocks 1602 and 1612, respectively. For example, whenthe determination order information of reference coding units isobtained with respect to each processing block, different kinds of thedetermination order information of reference coding units may beobtained for the processing blocks 1602 and 1612. When the determinationorder 1604 of reference coding units in the processing block 1602 is araster scan order, reference coding units included in the processingblock 1602 may be determined according to the raster scan order. On thecontrary, when the determination order 1614 of reference coding units inthe other processing block 1612 is a backward raster scan order,reference coding units included in the processing block 1612 may bedetermined according to the backward raster scan order.

According to an embodiment, the image decoding apparatus 100 may decodethe determined one or more reference coding units. The image decodingapparatus 100 may decode an image, based on the reference coding unitsdetermined as described above. A method of decoding the reference codingunits may include various image decoding methods.

According to an embodiment, the image decoding apparatus 100 may obtainblock shape information indicating the shape of a current coding unit orsplit shape mode information indicating a splitting method of thecurrent coding unit, from the bitstream, and may use the obtainedinformation. The split shape mode information may be included in thebitstream related to various data units. For example, the image decodingapparatus 100 may use the split shape mode information included in asequence parameter set, a picture parameter set, a video parameter set,a slice header, or a slice segment header. Furthermore, the imagedecoding apparatus 100 may obtain, from the bitstream, a syntax elementcorresponding to the block shape information or the split shape modeinformation according to each largest coding unit, each reference codingunit, or each processing block, and may use the obtained syntax element.

A method of determining a splitting rule according to an embodiment ofthe present disclosure will be described in detail.

The image decoding apparatus 100 may determine a splitting rule of animage. The splitting rule may be previously determined between the imagedecoding apparatus 100 and the image encoding apparatus 200. The imagedecoding apparatus 100 may determine the splitting rule of the imagebased on information obtained from a bitstream. The image decodingapparatus 100 may determine the splitting rule based on informationobtained from at least one of a sequence parameter set, a pictureparameter set, a video parameter set, a slice header, and a slicesegment header. The image decoding apparatus 100 may differentlydetermine the splitting rule according to a frame, a slice, a temporallayer, a largest coding unit, or a coding unit.

The image decoding apparatus 100 may determine the splitting rule basedon a block shape of a coding unit. The block shape may include a size, ashape, a ratio between a width and a height, and a direction of thecoding unit. The image encoding apparatus 200 and the image decodingapparatus 100 may previously determine to determine the splitting rulebased on the block shape of the coding unit. However, the presentdisclosure is not limited thereto. The image decoding apparatus 100 maydetermine the splitting rule, based on the information obtained from thebitstream received from the image encoding apparatus 200.

The shape of the coding unit may include a square shape and a non-squareshape. When the width and the height of the coding unit are the same,the image decoding apparatus 100 may determine that the shape of thecoding unit is a square shape. Also, when the width and the height ofthe coding unit are not the same, the image decoding apparatus 100 maydetermine that the shape of the coding unit is a non-square shape.

The size of the coding unit may include various sizes such as 4×4, 8×4,4×8, 8×8, 16×4, 16×8, . . . , and 256×256. The size of the coding unitmay be classified according to the length of a long side, the length ofa short side, or the area of the coding unit. The image decodingapparatus 100 may apply the same splitting rule to coding unitsbelonging to the same group. For example, the image decoding apparatus100 may classify coding units whose long sides have the same length ascoding units having the same size. Also, the image decoding apparatus100 may apply the same splitting rule to coding units whose long sideshave the same length.

The ratio between the width and the height of the coding unit mayinclude 1:2, 2:1, 1:4, 4:1, 1:8, 8:1, 1:16, 16:1, 32:1, or 1:32. Also,the direction of the coding unit may include a horizontal direction anda vertical direction. The horizontal direction may indicate a case wherethe length of the width of the coding unit is greater than the length ofthe height of the coding unit. The vertical direction may indicate acase where the length of the width of the coding unit is less than thelength of the height of the coding unit.

The image decoding apparatus 100 may adaptively determine the splittingrule based on the size of the coding unit. The image decoding apparatus100 may differently determine an allowable split shape mode based on thesize of the coding unit. For example, the image decoding apparatus 100may determine whether splitting is allowed based on the size of thecoding unit. The image decoding apparatus 100 may determine a splitdirection according to the size of the coding unit. The image decodingapparatus 100 may determine an allowable split type according to thesize of the coding unit.

Determining the splitting rule based on the size of the coding unit maybe the splitting rule that is previously determined between the imageencoding apparatus 200 and the image decoding apparatus 100. Also, theimage decoding apparatus 100 may determine the splitting rule, based onthe information obtained from the bitstream.

The image decoding apparatus 100 may adaptively determine the splittingrule based on a location of the coding unit. The image decodingapparatus 100 may adaptively determine the splitting rule based on thelocation of the coding unit in the image.

Also, the image decoding apparatus 100 may determine the splitting ruleso that coding units generated using different split paths do not havethe same block shape. However, the present disclosure is not limitedthereto, and the coding units generated using different split paths mayhave the same block shape. The coding units generated using differentsplit paths may have different decoding processing orders. A decodingprocessing order has been described with reference to FIG. 12, and thusa detailed explanation thereof will not be provided here.

FIG. 17 illustrates coding units determinable per picture when acombination of shapes into which a coding unit is splittable isdifferent per picture, according to an embodiment.

Referring to FIG. 17, the image decoding apparatus 100 may differentlydetermine, per picture, a combination of shapes into which a coding unitis splittable. For example, the image decoding apparatus 100 may decodean image by using a picture 1700 that is splittable into 4 coding units,a picture 1710 that is splittable into 2 or 4 coding units, and apicture 1720 that is splittable into 2, 3, or 4 coding units, from amongone or more pictures included in the image. In order to split thepicture 1700 into a plurality of coding units, the image decodingapparatus 100 may use only split shape information indicating that thepicture 1700 is split into 4 square coding units. In order to split thepicture 1710, the image decoding apparatus 100 may use only split shapeinformation indicating that the picture 1710 is split into 2 or 4 codingunits. In order to split the picture 1720, the image decoding apparatus100 may use only split shape information indicating that the picture1720 is split into 2, 3, or 4 coding units. Because such a combinationof split shapes is merely an embodiment for describing operations of theimage decoding apparatus 100, the combination of split shapes should notbe interpreted as being limited to the embodiment and variouscombinations of split shapes may be used according to predetermined dataunits.

According to an embodiment, the bitstream obtainer 110 of the imagedecoding apparatus 100 may obtain a bitstream including an indexindicating a combination of split shape information according topredetermined data units (e.g., sequences, pictures, or slices). Forexample, the bitstream obtainer 110 may obtain the index indicating thecombination of split shape information from a sequence parameter set, apicture parameter set, or a slice header. The image decoding apparatus100 may determine a combination of split shapes into which a coding unitis splittable according to predetermined data units by using theobtained index, and thus different combinations of split shapes may beused according to predetermined data units.

FIG. 18 illustrates various shapes of a coding unit determinable basedon split shape mode information representable as a binary code,according to an embodiment.

According to an embodiment, the image decoding apparatus 100 may split acoding unit into various shapes by using block shape information andsplit shape mode information obtained by the bitstream obtainer 110.Shapes into which a coding unit is splittable may correspond to variousshapes including the shapes described with reference to the aboveembodiments.

Referring to FIG. 18, the image decoding apparatus 100 may split asquare coding unit into at least one of a horizontal direction and avertical direction and may split a non-square coding unit in ahorizontal direction or a vertical direction, based on split shape modeinformation.

According to an embodiment, when the image decoding apparatus 100 isable to split a square coding unit in a horizontal direction and avertical direction to obtain 4 square coding units, the number of splitshapes that may be indicated by the split shape mode information aboutthe square coding unit may be 4. According to an embodiment, the splitshape mode information may be represented as a 2-digit binary code, anda binary code may be allocated to each split shape. For example, when acoding unit is not split, the split shape mode information may berepresented as (00)b; when a coding unit is split in a horizontaldirection and a vertical direction, the split shape mode information maybe represented as (01)b; when a coding unit is split in a horizontaldirection, the split shape mode information may be represented as (10)b;and when a coding unit is spilt in a vertical direction, the split shapemode information may be represented as (11)b.

According to an embodiment, when the image decoding apparatus 100 splitsa non-square coding unit in a horizontal direction or a verticaldirection, types of split shapes that may be indicated by the splitshape mode information may be determined according to the number ofcoding units into which a coding unit is split. Referring to FIG. 18,the image decoding apparatus 100 may split a non-square coding unit intoup to 3 coding units according to an embodiment. The image decodingapparatus 100 may split a coding unit into two coding units, and in thiscase, the split shape mode information may be represented as (10)b. Theimage decoding apparatus 100 may split a coding unit into three codingunits, and in this case, the split shape mode information may berepresented as (11)b. The image decoding apparatus 100 may determine notto split a coding unit, and in this case, the split shape modeinformation may be represented as (0)b. That is, in order to use abinary code indicating split shape mode information, the image decodingapparatus 100 may use variable length coding (VLC), instead of fixedlength coding (FLC).

According to an embodiment, referring to FIG. 18, a binary code of splitshape mode information indicating that a coding unit is not split may berepresented as (0)b. When a binary code of split shape mode informationindicating that a coding unit is not split is set to (00)b, all 2-bitbinary codes of split shape mode information have to be used despitethat there is no split shape mode information set to (01)b. However, asshown in FIG. 18, when 3 split shapes are used for a non-square codingunit, the image decoding apparatus 100 may determine not to split acoding unit even by using a 1-bit binary code (0)b as the split shapemode information, thereby efficiently using a bitstream. However, splitshapes of a non-square coding unit, which are indicated by the splitshape mode information, should not be interpreted as being limited to 3shapes shown in FIG. 18 and should be interpreted as being variousshapes including the above embodiments.

FIG. 19 illustrates other shapes of a coding unit determinable based onsplit shape mode information representable as a binary code, accordingto an embodiment.

Referring to FIG. 19, the image decoding apparatus 100 may split asquare coding unit in a horizontal direction or a vertical direction andmay split a non-square coding unit in a horizontal direction or avertical direction, based on split shape mode information. That is, thesplit shape mode information may indicate that a square coding unit issplit in one direction. In this case, a binary code of the split shapemode information indicating that a square coding unit is not split maybe represented as (0)b. When a binary code of the split shape modeinformation indicating that a coding unit is not split is set to (00)b,all 2-bit binary codes of the split shape mode information have to beused despite that there is no split shape mode information set to (01)b.However, as shown in FIG. 19, when 3 split shapes are used for a squarecoding unit, the image decoding apparatus 100 may determine not to splita coding unit even by using a 1-bit binary code (0)b as the split shapemode information, thereby efficiently using a bitstream. However, splitshapes of a square coding unit, which are indicated by the split shapemode information, should not be interpreted as being limited to 3 shapesshown in FIG. 19 and should be interpreted as being various shapesincluding the above embodiments.

According to an embodiment, block shape information or split shape modeinformation may be represented by using a binary code, and suchinformation may be immediately generated as a bitstream. Alternatively,block shape information or split shape mode information representable asa binary code may not be immediately generated as a bitstream and may beused as a binary code input during context adaptive binary arithmeticcoding (CABAC).

According to an embodiment, a process, performed by the image decodingapparatus 100, of obtaining syntax about block shape information orsplit shape mode information through CABAC will be described. Abitstream including a binary code for the syntax may be obtained by thebitstream obtainer 110. The image decoding apparatus 100 may detect asyntax element indicating the block shape information or the split shapemode information by de-binarizing a bin string included in the obtainedbitstream. According to an embodiment, the image decoding apparatus 100may obtain a set of binary bin strings corresponding to the syntaxelement to be decoded and may decode each bin by using probabilityinformation, and the image decoding apparatus 100 may repeatedly performthis process until a bin string including such decoded bins is the sameas one of pre-obtained bin strings. The image decoding apparatus 100 maydetermine the syntax element by de-binarizing the bin string.

According to an embodiment, the image decoding apparatus 100 maydetermine syntax about a bin string by performing a decoding process ofadaptive binary arithmetic coding, and may update a probability modelfor bins obtained by the bitstream obtainer 110. Referring to FIG. 18,the bitstream obtainer 110 of the image decoding apparatus 100 mayobtain a bitstream indicating a binary code indicating split shape modeinformation according to an embodiment. The image decoding apparatus 100may determine syntax about the split shape mode information by using theobtained binary code having a size of 1 bit or 2 bits. In order todetermine the syntax about the split shape mode information, the imagedecoding apparatus 100 may update a probability of each bit from amongthe 2 bits of the binary code. That is, the image decoding apparatus 100may update a probability that a next bin has a value of 0 or 1 duringcoding, according to whether a value of a first bin in the 2-bits of thebinary code is 0 or 1.

According to an embodiment, while determining the syntax, the imagedecoding apparatus 100 may update a probability of the bins used in aprocess of decoding the bins of the bin string for the syntax, and theimage decoding apparatus 100 may determine that a specific bit in thebin string has the same probability without updating the probability.

Referring to FIG. 18, while determining syntax by using a bin stringindicating split shape mode information about a non-square coding unit,the image decoding apparatus 100 may determine the syntax about thesplit shape mode information by using one bin having a value of 0 whenthe non-square coding unit is not split. That is, when block shapeinformation indicates that a current coding unit has a non-square shape,a first bin of a bin string for the split shape information may be 0when the non-square coding unit is not split and may be 1 when thenon-square coding unit is split into two or three coding units.Accordingly, a probability that the first bin of the bin string of thesplit shape mode information about the non-square coding unit is 0 maybe ⅓, and a probability that the first bin of the bin string of thesplit shape mode information about the non-square coding unit is 1 maybe ⅔. As described above, because the split shape mode informationindicating that the non-square coding unit is not split may representonly a 1-bit bin string having a value of 0, the image decodingapparatus 100 may determine syntax about the split shape modeinformation by determining whether a second bin is 0 or 1 only when thefirst bin of the split shape mode information is 1. According to anembodiment, when the first bin for the split shape mode information is1, the image decoding apparatus 100 may decode a bin by determining thatprobabilities that the second bin is 0 and 1 are the same.

According to an embodiment, the image decoding apparatus 100 may usevarious probabilities for each bin while determining a bin of a binstring for split shape mode information. According to an embodiment, theimage decoding apparatus 100 may differently determine probabilities ofbins for split shape mode information according to a direction of anon-square block. According to an embodiment, the image decodingapparatus 100 may differently determine the probabilities of the binsfor the split shape mode information according to an area or a length ofa long side of a current coding unit. According to an embodiment, theimage decoding apparatus 100 may differently determine the probabilitiesof the bins for the split shape mode information according to at leastone of a shape and the length of the long side of a current coding unit.

According to an embodiment, the image decoding apparatus 100 maydetermine that the probabilities of the bins for the split shape modeinformation are the same with respect to coding units having apredetermined size or more. For example, the image decoding apparatus100 may determine that the probabilities of the bins for the split shapemode information are the same with respect to coding units having a sizeequal to or greater than 64 samples based on a length of a long side ofeach coding unit.

According to an embodiment, the image decoding apparatus 100 maydetermine an initial probability of bins constituting a bin string ofthe split shape mode information based on a slice type (e.g., anI-slice, a P-slice, a B-slice, or the like).

FIG. 20 is a block diagram of an image encoding and decoding system 2000for performing loop filtering.

An encoding end 2010 of the image encoding and decoding system 2000transmits an encoded bitstream of an image, and a decoding end 2050receives and decodes the bitstream and outputs a reconstruction image.The encoding end 2010 may have a configuration similar to that of theimage encoding apparatus 200 which will be described below, and thedecoding end 2050 may have a configuration similar to that of the imagedecoding apparatus 100.

In the encoding end 2010, a prediction encoder 2015 outputs a referenceimage through inter prediction and intra prediction, and a transformerand quantizer 2020 quantizes residual data between the reference imageand a current input image into a quantized transform coefficient andoutputs the quantized transform coefficient. An entropy encoder 2025encodes and transforms the quantized transform coefficient into abitstream and outputs the bitstream. The quantized transform coefficientis reconstructed as data in a spatial domain by a de-quantizer andinverse converter 2030, and the reconstructed data in the spatial domainis output as a reconstruction image through a deblocking filter 2035 anda loop filter 2040. The reconstruction image may be used as a referenceimage of a next input image through the prediction encoder 2015.

Encoded image data from among the bitstream received by the decoding end2050 is reconstructed as residual data in a spatial domain through anentropy decoder 2055 and a de-quantizer and inverse converter 2060.Image data in a spatial domain is formed as the residual data and areference image output from a prediction decoder 2075 are combined, anda deblocking filter 2065 and a loop filter 2070 may filter the imagedata in the spatial domain and may output a reconstruction image for acurrent original image. The reconstruction image may be used as areference image for a next original image by the prediction decoder2075.

The loop filter 2040 of the encoding end 2010 performs loop filtering byusing filter information input according to a user input or a systemsetting. The filter information used by the loop filter 2040 is outputto the entropy encoding end 2010, and is transmitted along with theencoded image data to the decoding end 2050. The loop filter 2070 of thedecoding end 2050 may perform loop filtering based on the filterinformation input from the decoding end 2050.

The above various embodiments are for describing an operation related toan image decoding method performed by the image decoding apparatus 100.An operation of the image encoding apparatus 200 for performing an imageencoding method corresponding to a reverse order process of the imagedecoding method will be described with reference to various embodiments.

FIG. 2 is a block diagram of the image encoding apparatus 200 forencoding an image based on at least one of block shape information andsplit shape mode information, according to an embodiment.

The image encoding apparatus 200 may include an encoder 220 and abitstream generator 210. The encoder 220 may receive an input image andmay encode the input image. The encoder 220 may encode the input imageand may obtain at least one syntax element. The syntax element mayinclude at least one from among a skip flag, prediction mode, motionvector difference, motion vector prediction method (or index), transformquantized coefficient, coded block pattern, coded block flag, intraprediction mode, direct flag, merge flag, delta QP, reference index,prediction direction, and transform index. The encoder 220 may determinea context model based on block shape information including at least onefrom among a shape, a direction, a ratio between a width and a height,and a size of a coding unit.

The bitstream generator 210 may generate a bitstream based on theencoded input image. For example, the bitstream generator 210 maygenerate the bitstream by entropy encoding the syntax element based onthe context model. Also, the image encoding apparatus 200 may transmitthe bitstream to the image decoding apparatus 100.

According to an embodiment, the encoder 220 of the image encodingapparatus 200 may determine a shape of a coding unit. For example, thecoding unit may have a square shape or a non-square shape, andinformation indicating the shape may be included in the block shapeinformation.

According to an embodiment, the encoder 220 may determine which shapethe coding unit is to be split into. The encoder 220 may determine ashape of at least one coding unit included in the coding unit, and thebitstream generator 210 may generate the bitstream including split shapemode information including the information about the shape of the codingunit.

According to an embodiment, the encoder 220 may determine whether thecoding unit is split or not split. When the encoder 220 determines thatonly one coding unit is included in the coding unit or the coding unitis not split, the bitstream generator 210 may generate the bitstreamincluding the split shape mode information indicating that the codingunit is not split. Also, the encoder 220 may split the coding unit intoa plurality of coding units, and the bitstream generator 210 maygenerate the bitstream including the split shape mode informationindicating that the coding unit is split into the plurality of codingunits.

According to an embodiment, information indicating the number of codingunits into which the coding unit is to be split or a direction in whichthe coding unit is to be split may be included in the split shape modeinformation. For example, the split shape mode information may indicatethat the coding unit is split in at least one of a vertical directionand a horizontal direction or is not split.

The image encoding apparatus 200 determines the split shape modeinformation based on a split shape mode of the coding unit. The imageencoding apparatus 200 determines the context model based on at leastone of the shape, the direction, the ratio between the width and theheight, and the size of the coding unit. The image encoding apparatus200 generates the split shape mode information for splitting the codingunit based on the context model as the bitstream.

In order to determine the context model, the image encoding apparatus200 may obtain an arrangement for corresponding at least one of theshape, the direction, the ratio between the width and the height, andthe size of the coding unit to an index for the context model. The imageencoding apparatus 200 may obtain the index for the context model basedon at least one of the shape, the direction, the ratio between the widthand the height, and the size of the coding unit in the arrangement. Theimage encoding apparatus 200 may determine the context model based onthe index for the context model.

In order to determine the context model, the image encoding apparatus200 may determine the context model further based on block shapeinformation including at least one of a shape, a direction, a ratiobetween a width and a height, and a size of a neighboring coding unitadjacent to the coding unit. Also, the neighboring coding unit mayinclude at least one from among coding units located at a left lowerside, a left side, a left upper side, an upper side, a right upper side,a right side, or a right lower side of the coding unit.

Also, in order to determine the context model, the image encodingapparatus 200 may compare a length of a width of an upper neighboringcoding unit with a length of the width of the coding unit. Also, theimage encoding apparatus 200 may compare a length of a height of leftand right neighboring coding units with a length of the height of thecoding unit. Also, the image encoding apparatus 200 may determine thecontext model based on comparison results.

An operation of the image encoding apparatus 200 is similar to anoperation of the image decoding apparatus 100 described with referenceto FIGS. 3 through 20, and thus a detailed explanation thereof is notprovided here.

An image decoding apparatus 2100 and an image encoding apparatus 3600according to an embodiment will be described with reference to FIGS. 21through 37.

FIG. 21 is a block diagram of the image decoding apparatus 2100according to an embodiment.

Referring to FIG. 21, the image decoding apparatus 2100 according to anembodiment may include an obtainer 2110 and a motion information decoder2130.

The image decoding apparatus 2100 may obtain a bitstream generated as aresult of encoding an image, and may decode motion information for interprediction based on information included in the bitstream.

The image decoding apparatus 2100 according to an embodiment may includea central processor (not shown) for controlling the obtainer 2110 andthe motion information decoder 2130. Alternatively, the obtainer 2110and the motion information decoder 2130 may be operated by their ownprocessors (not shown), and the image decoding apparatus 2100 mayoperate as the processors (not shown) organically operate.Alternatively, the obtainer 2110 and the motion information decoder 2130may be controlled by an external processor (not shown) of the imagedecoding apparatus 2100.

The image decoding apparatus 2100 may include one or more data storages(not shown) in which input/output data of the obtainer 2110 and themotion information decoder 2130 are stored. The image decoding apparatus2100 may include a memory controller (not shown) for controlling datainput/output to/from the data storages (not shown).

In order to reconstruct an image through image decoding, the imagedecoding apparatus 2100 may perform an image decoding operationincluding prediction in association with an internal video decodingprocessor or an external video decoding processor. The internal videodecoding processor of the image decoding apparatus 2100 according anembodiment may perform a basic image decoding operation as a separateprocessor, or a central processing unit or a graphics processing unitmay include an image decoding processing module and may perform a basicimage decoding operation.

The image decoding apparatus 2100 may be included in the image decodingapparatus 100. For example, the obtainer 2110 may be included in thebitstream obtainer 110 of the image decoding apparatus 100 of FIG. 1,and the motion information decoder 2130 may be included in the decoder120 of the image decoding apparatus 100.

The obtainer 2110 receives a bitstream generated as a result of encodingan image. The bitstream may include information for determining a motionvector used for inter prediction of a current block. The current blockthat is a block generated by being split according to a tree structurefrom an image may correspond to, for example, a largest coding unit, acoding unit, or a transform unit.

The obtainer 2110 may determine the current block based on block shapeinformation and/or split shape mode information included in at least oneof a sequence parameter set, a picture parameter set, a video parameterset, a slice header, and a slice segment header. Furthermore, theobtainer 2110 may obtain a syntax element corresponding to the blockshape information or the split shape mode information from the bitstreamfor each largest coding unit, reference coding unit, or processing blockand may use the syntax element to determine the current block.

The bitstream may include information indicating a prediction mode ofthe current block, and the prediction mode of the current block mayinclude at least one of an intra mode, an inter mode, a merge mode, adirect mode, a skip mode, and a preset mode according to the presentdisclosure. The preset mode may be a mode for determining a predictionmotion vector of the current block from among prediction motion vectorcandidates classified according to a disparity distance and a disparitydirection.

In an embodiment, the bitstream may include at least one from amonginformation indicating whether the preset mode is applied to the currentblock, information indicating a base motion vector of the current block,information indicating the prediction motion vector of the currentblock, information indicating the disparity distance for determining theprediction motion vector candidates from a base motion vector candidate,information indicating the disparity direction for determining theprediction motion vector candidates from the base motion vectorcandidate, information indicating a priority of base motion vectorcandidates, information indicating a priority of disparity distances,and information indicating a priority of disparity directions.

The obtainer 2110 may obtain the information included in the bitstreamat a level corresponding to at least one of a coding unit, a transformunit, a largest coding unit, a slice unit, and a picture unit.

The motion information decoder 2130 determines a motion vector of thecurrent block based on the information included in the bitstream.

The motion information decoder 2130 may check whether the preset mode isapplied to the current block based on the information included in thebitstream. The information indicating whether the preset mode is appliedmay include a flag or an index.

For example, when it is first checked that a prediction mode differentfrom the preset mode is applied to the current block, the obtainer 2110may obtain the information indicating whether the preset mode is appliedto the current block. For example, when the skip mode is applied to thecurrent block or the direct mode is applied to the current block, theinformation indicating whether the preset mode is applied may beextracted from the bitstream.

In an example, the motion information decoder 2130 may not extract theinformation indicating whether the preset mode is applied from thebitstream, and may determine whether the preset mode is applied to thecurrent block based on information related to at least one of thecurrent block, a previously decoded block, a current slice, a previouslydecoded slice, a current picture, and a previously decoded picture. Inthis case, the motion information decoder 2130 may determine whether thepreset mode is applied by using the same criterion as that of the imageencoding apparatus 3600.

When the preset mode is applied to the current block, the motioninformation decoder 2130 may determine prediction motion vectorcandidates for one or more base motion vector candidates. The motioninformation decoder 2130 may determine one or more prediction motionvector candidates changed according to a pre-determined disparitydistance and a pre-determined disparity direction from each of one ormore base motion vector candidates. The one or more prediction motionvector candidates determined for the one or more base motion vectorcandidates may be classified according to the disparity distance and thedisparity direction.

The disparity distance that is a value determined based on a base pixelunit (e.g., a ¼ pixel unit). The disparity distance may indicate howmany base pixel units correspond to a difference. For example, when adisparity distance between a base motion vector candidate and aprediction motion vector candidate is 1, it may mean that the predictionmotion vector candidate and the base motion vector candidate aredifferent by a pixel distance corresponding to one ¼ pixel unit. Thedisparity distance may have a value corresponding to an integer, arational number, or an irrational number.

When a smallest pixel unit indicatable by the motion vector of thecurrent block is the same as the base pixel unit, the motion informationdecoder 2130 may determine the prediction motion vector candidatesaccording to the pre-determined disparity distance.

However, when the smallest pixel unit indicatable by the motion vectorof the current block is different from the base pixel unit, the motioninformation decoder 2130 may scale the pre-determined disparitydistance, and then may determine the prediction motion vector candidatesfor each of the one or more base motion vector candidates based on thescaled disparity distance.

When the motion vector of the current block may indicate pixelscorresponding to an integer pixel unit, a ½ pixel unit, a ¼ pixel unit,and a ⅛ pixel unit, the smallest pixel unit indicatable by the motionvector of the current block is the ⅛ pixel unit. When the base pixelunit is a ¼ pixel unit, the motion information decoder 2130 may up-scalethe disparity distance for determining the prediction motion vectorcandidates.

In an example, the motion information decoder 2130 may scale thedisparity distance according to a ratio between the smallest pixel unitindicatable by the motion vector of the current block and the base pixelunit.

In an example, when the base pixel unit is greater than the smallestpixel unit indicatable by the motion vector of the current block, themotion information decoder 2130 may up-scale the disparity distance.

A process of determining the prediction motion vector candidates basedon the scaled disparity distance will be described below with referenceto FIG. 26.

In an embodiment, the one or more base motion vector candidates of thecurrent block may be determined based on a motion vector of aneighboring block that is spatially and temporally related to thecurrent block. The neighboring block that is spatially and temporallyrelated to the current block may include a block that is decoded earlierthan the current block.

The neighboring block spatially related to the current block mayinclude, but is not limited to, a block located at a left side of thecurrent block and a block located at an upper side of the current block.Also, the neighboring block temporally related to the current block mayinclude, for example, a block co-located with the current block fromamong blocks included in a reference picture different from a currentpicture including the current block and a block spatially adjacent tothe block co-located with the current block.

In an embodiment, the motion information decoder 2130 may determinemotion vectors of the neighboring block related to the current block asthe one or more base motion vector candidates. Alternatively, the motioninformation decoder 2130 may determine the one or more base motionvector candidates by changing the motion vectors of the neighboringblock related to the current block. Alternatively, the motioninformation decoder 2130 may determine the one or more base motionvector candidates by combining the motion vectors of the neighboringblock related to the current block according to a predeterminedequation.

In an embodiment, the motion information decoder 2130 may determinemotion vectors of the neighboring blocks related to the current block inwhich a picture order count (POC) difference of a reference picturebetween the motion vectors is equal to or greater than a preset value asthe base motion vector candidates.

In an embodiment, the motion information decoder 2130 may determine theone or more base motion vector candidates in the same manner as a methodof determining a candidate list of a motion vector predictor in anadaptive motion vector prediction (AMVP) mode or a merge mode of HEVC.

In an embodiment, the motion information decoder 2130 may determine azero motion vector having 0 as a component as the one or more basemotion vector candidates.

When the one or more base motion vector candidates are determined, themotion information decoder 2130 may determine a base motion vector ofthe current block based on the information included in the bitstreamfrom among the one or more base motion vector candidates.

Information indicating the base motion vector of the current block maybe encoded by using a fixed length coding (FLC) method, a unary codingmethod, or a truncated unary coding method and may be included in thebitstream.

In an embodiment, when the number of the base motion vector candidatesis 1, the obtainer 2110 may not extract information for determining thebase motion vector of the current block from the bitstream. In thiscase, the motion information decoder 2130 may determine the one basemotion vector candidate as the base motion vector of the current block.

In an embodiment, the motion information decoder 2130 may not parse theinformation indicating the base motion information from the bitstream,and may determine the base motion vector of the current block from amongthe one or more base motion vector candidates, based on the informationrelated to at least one of the current block, the previously decodedblock, the current slice, the previously decoded slice, the currentpicture, and the previously decoded picture. In this case, the motioninformation decoder 2130 may determine the base motion vector by usingthe same criterion as that of the image encoding apparatus 3600.

When the base motion vector of the current block is determined, themotion information decoder 2130 may determine a prediction motion vectorof the current block from among the one or more prediction motion vectorcandidates determined based on the base motion vector.

The obtainer 2110 may obtain information indicating at least one of thedisparity distance and the disparity direction from the bitstream, andthe motion information decoder 2130 may determine the prediction motionvector of the current block from among one or more prediction motionvector candidates related to the base motion vector, based on theinformation indicating at least one of the disparity distance and thedisparity direction.

When the smallest pixel unit indicatable by the motion vector of thecurrent block is the same as the base pixel unit, the motion informationdecoder 2130 may determine a prediction motion vector candidatecorresponding to the disparity distance and the disparity directionverified from the bitstream as the prediction motion vector of thecurrent block.

However, in an embodiment, when the smallest pixel unit indicatable bythe motion vector of the current block is different from the base pixelunit, the motion information decoder 2130 may scale the disparitydistance verified from the bitstream, and then may determine aprediction motion vector candidate corresponding to the scaled disparitydistance and disparity direction as the prediction motion vector of thecurrent block.

For example, the motion information decoder 2130 may scale the disparitydistance verified from the bitstream according to a ratio between thesmallest pixel unit indicatable by the motion vector of the currentblock and the base pixel unit. The motion information decoder 2130 mayup-scale the disparity distance checked from the bitstream, when thebase pixel unit (e.g., a ¼ pixel unit) is greater than the smallestpixel unit (e.g., a ⅛ pixel unit) indicatable by the motion vector ofthe current block.

The scaled disparity distance may indicate how many smallest pixel unitscorrespond to a difference. For example, when the smallest pixel unitindicatable by the motion vector of the current block is a ⅛ pixel unitand the scaled disparity distance is 2, the motion information decoder2130 may determine a prediction motion vector candidate different by apixel distance corresponding to two ⅛ pixel units from the base motionvector as the prediction motion vector of the current block.

As described above, the disparity distance that is pre-determined basedon the base pixel unit is used to determine the prediction motion vectorcandidates based on the one or more base motion vector candidates.Because the information indicating the disparity distance based on thebase unit is signaled through the bitstream, the motion informationdecoder 2130 having precision high enough to indicate the smallest pixelunit different from the base pixel unit may scale, according to thesmallest pixel unit, the disparity distance that is signaled through thebitstream.

A pixel distance corresponding to the disparity distance determinedbased on the base pixel unit and a pixel distance corresponding to thedisparity distance scaled based on the smallest pixel unit may be thesame. However, when the smallest pixel unit is less than the base pixelunit (that is, when the precision of the motion vector is higher), andthe disparity distance determined based on the base pixel unit is notscaled, a prediction motion vector different from the prediction motionvector determined by the image encoding apparatus 3600 may be determinedas the prediction motion vector of the current block.

In an embodiment, information indicating the smallest pixel unitindicatable by the motion vector of the current block may be included inthe bitstream. The obtainer 2110 may obtain the information indicatingthe smallest pixel unit from the bitstream corresponding to a level ofat least one of a block, a slice, and a picture.

At least one from among the information indicating the disparitydistance for specifying the prediction motion vector of the currentblock and the information indicating the disparity direction may beobtained from the bitstream of a transform unit level, a coding unitlevel, a largest coding unit level, a slice level, or a picture level.

The Information indicating the disparity distance and the disparitydirection, for specifying the prediction motion vector of the currentblock, may be encoded by using an FLC method, a unary coding method, ora truncated unary coding method and may be included in the bitstream.

The obtainer 2110 may decode the information indicating the disparitydirection, e.g., at least one of indexes indicating the disparitydirection, by using a context model from the bitstream.

In an embodiment, the motion information decoder 2130 may not parse atleast one of the information indicating the disparity distance and thedisparity direction from the bitstream, and may determine the predictionmotion vector of the current block from among the one or more predictionmotion vector candidates, based on the information related to at leastone of the current block, the previously decoded block, the currentslice, the previously decoded slice, the current picture, and thepreviously decoded picture. In this case, the motion information decoder2130 may determine the prediction motion vector by using the samecriterion as that of the image encoding apparatus 3600.

When the prediction motion vector of the current block is determined,the motion information decoder 2130 may determine the motion vector ofthe current block based on the prediction motion vector of the currentblock. In an embodiment, the motion information decoder 2130 maydetermine the prediction motion vector of the current block as themotion vector of the current block.

When information indicating a differential motion vector is included inthe bitstream, the motion information decoder 2130 may determine thedifferential motion vector of the current block based on the informationindicating the differential motion vector. In an example, theinformation indicating the differential motion vector may be encoded byusing an exponential Golomb coding method and may be included in thebitstream.

The obtainer 2110 may obtain the information indicating the differentialmotion vector from the bitstream of a transform unit level, a codingunit level, a largest coding unit level, a slice level, or a picturelevel.

The motion information decoder 2130 may determine the motion vector ofthe current block by applying the differential motion vector to theprediction motion vector. In an example, the motion information decoder2130 may determine the motion vector of the current block by adding thedifferential motion vector to the prediction motion vector.

In an embodiment, when a prediction direction of the current block is abi-direction, the differential motion vector may be included in thebitstream for only one uni-direction. For example, the informationindicating the differential motion vector may be included in thebitstream for only one uni-direction from among a list 0 direction and alist 1 direction.

When the differential motion vector is included in the bitstream foronly the list 0 direction, the motion information decoder 2130 maydetermine the motion vector of the list 0 direction of the current blockby applying the differential motion vector for the list 0 direction tothe prediction motion vector for the list 0 direction. The motioninformation decoder 2130 may determine the prediction motion vector forthe list 1 direction as the motion vector of the list 1 direction, ormay determine the motion vector of the list 1 direction of the currentblock by applying the differential motion vector for the list 0direction to the prediction motion vector for the list 1 direction.

Because the present disclosure is related to a method of representing amotion vector, the present disclosure may be used for a variety forms ofmotion vectors or a variety forms of differential motion vectors used ina current encoding device. That is, while an existing method includesencoding and sending a motion vector (or a differential motion vector)(e.g., a differential motion vector in an AMVP mode or a differentialmotion vector in an affine mode), the present disclosure applies asimple location indicating method using a distance and a direction,thereby achieving high encoding efficiency.

Alternatively, the present disclosure may be additionally applied to anexisting mode and may represent more motion vectors (or differentialmotion vectors) to be considered. All algorithms used for interprediction need to know an accurate location of a block to performmotion compensation. In this case, when a method according to thepresent disclosure is applied, the possibility of referencingneighboring blocks may be checked and encoded by using a minimum numberof bits. Accordingly, efficiency in encoding performance may be greatlyimproved. It may be determined whether the method according to thepresent disclosure is applied in high level syntax, thereby reducing theburden of signaling bits.

A method of determining prediction motion vector candidatescorresponding to one base motion vector candidate will be described withreference to FIGS. 22 through 25.

FIGS. 22 through 25 each illustrate, in a coordinate plane, predictionmotion vector candidates determined according to a disparity distancethat is pre-determined based on a base pixel unit corresponding to a ¼pixel unit.

Referring to FIGS. 22 through 25, the motion information decoder 2130may determine candidates located according to a predetermined shape, todetermine prediction motion vector candidates. The predetermined shapemay be a polygonal shape such as a diamond shape or a quadrangularshape, or a shape similar to a circular shape.

The motion information decoder 2130 may determine candidates at acertain disparity distance from a point corresponding to a base motionvector candidate as the prediction motion vector candidates. The motioninformation decoder 2130 may determine prediction motion vectorcandidates at a first disparity distance from a preset point as a firstcandidate group, may determine prediction motion vector candidates at asecond disparity distance from the preset point as a second candidategroup, and may determine prediction motion vector candidates at ann^(th) disparity distance from the preset point as an n^(th) candidategroup. The motion information decoder 2130 may determine predictionmotion vector candidates closet to the preset point as a first candidategroup and may determine prediction motion vector candidates secondclosest to the preset point as a second candidate group. That is, as adisparity distance increases, the number (or index) of a candidate groupmay sequentially increase.

As the number of the candidate group increases, the disparity distancemay increase at logarithmic scale intervals or nonlinear intervals.Also, as the number of the candidate group increases, the disparitydistance may increase at N intervals (N is an integer) (e.g., N, 2N, 3N,. . . ). Also, as the candidate group increases, the disparity distancemay increase so that a difference between the disparity distance and aprevious disparity distance is constant.

The disparity distance may be determined according to a user'sdefinition. Alternatively, the motion information decoder 2130 maydirectly determine the disparity distance based on information relatedto a current block, a temporal layer, or a GOP, or may obtaininformation indicating the disparity distance for determining theprediction motion vector candidates through a bitstream.

The motion information decoder 2130 may determine the disparity distancefor determining the prediction motion vector candidate of the currentblock according to the disparity distance determined at a level higherthan a level corresponding to the current block.

The number of prediction motion vector candidates may be independentlydetermined for each candidate group. The motion information decoder 2130may determine the number of prediction motion vector candidates for eachcandidate group of the current block according to number informationdetermined at a level higher than a level corresponding to the currentblock.

FIGS. 22 and 23 illustrate a case where the number of prediction motionvector candidates in each candidate group is 4. Also, although thenumber of candidates groups is 3 in FIGS. 22 and 23, the number ofcandidate groups is not limited to 3.

Referring to FIG. 22, the motion information decoder 2130 may determineprediction motion vector candidates having a diamond distribution basedon a base motion vector candidate (x, y) 2201.

The motion information decoder 2130 may determine prediction motionvector candidates (x+1, y) 2202, (x−1, y) 2203, (x, y+1) 2204, and (x,y−1) 2205 at a disparity distance of 1 from the base motion vectorcandidate (x, y) 2201 as a first candidate group.

The motion information decoder 2130 may determine prediction motionvector candidates (x+2, y) 2206, (x−2, y) 2207, (x, y+2) 2208, and (x,y−2) 2209 at a disparity distance of 2 from the base motion vectorcandidate (x, y) 2201 as a second candidate group.

The motion information decoder 2130 may determine prediction motionvector candidates (x+4, y) 2210, (x−4, y) 2211, (x, y+4) 2212, and (x,y−4) 2213 at a disparity distance of 4 from the base motion vectorcandidate (x, y) 2201 as a third candidate group.

Referring to FIG. 23, the motion information decoder 2130 may determineprediction motion vector candidates having a quadrangular distributionbased on the base motion vector candidate (x, y) 2201.

The motion information decoder 2130 may determine prediction motionvector candidates (x+1, y+1) 2221, (x+1, y−1) 2222, (x−1, y+1) 2223, and(x−1, y−1) 2224 at a disparity distance of about 1 from the base motionvector candidate (x, y) 2201 as a first candidate group.

The motion information decoder 2130 may determine prediction motionvector candidates (x+2, y+2) 2225, (x+2, y−2) 2226, (x−2, y+2) 2227, and(x−2, y−2) 2228 at a disparity distance of about 2 from the base motionvector candidate (x, y) 2201 as a second candidate group.

The motion information decoder 2130 may determine prediction motionvector candidates (x+4, y+4) 2229, (x+4, y−4) 2230, (x−4, y+4) 2231, and(x−4, y−4) 2232 at a disparity distance of about 4 from the base motionvector candidate (x, y) 2201 as a third candidate group.

Referring to FIG. 24, the motion information decoder 2130 may determinethe number of prediction motion vector candidates included in at leastone candidate group from among multiple candidate groups to be differentfrom that of the other candidate groups.

In detail, the motion information decoder 2130 may determine eightprediction motion vector candidates (x+1, y) 2202, (x−1, y) 2203, (x,y+1) 2204, (x, y−1) 2205, (x+1, y+1) 2221, (x+1, y−1) 2222, (x−1, y+1)2223, and (x−1, y−1) 2224 at a disparity distance of about 1 from thebase motion vector candidate (x, y) 2201 as a first candidate group.

Also, the motion information decoder 2130 may determine eight predictionmotion vector candidates (x+2, y) 2206, (x−2, y) 2207, (x, y+2) 2208,(x, y−2) 2209, (x+2, y+2) 2225, (x+2, y−2) 2226, (x−2, y+2) 2227, and(x−2, y−2) 2228 at a disparity distance of about 2 from the base motionvector candidate (x, y) 2201 as a second candidate group.

The motion information decoder 2130 may determine four prediction motionvector candidates (x+4, y) 2210, (x−4, y) 2211, (x, y+4) 2212, and (x,y−4) 2213 at a disparity distance of about 4 from the base motion vectorcandidate (x, y) 2201 as a third candidate group.

Referring to FIG. 25, the motion information decoder 2130 may variouslydetermine distribution shapes of prediction motion vector candidatesaccording to candidate groups. In an example, the motion informationdecoder 2130 may determine the prediction motion vector candidates (x+1,y) 2202, (x−1, y) 2203, (x, y+1) 2204, and (x, y−1) 2205 having adiamond distribution based on the base motion vector candidate (x, y)2201 as a first candidate group.

Also, the motion information decoder 2130 may determine the predictionmotion vector candidates (x+2, y+2) 2225, (x+2, y−2) 2226, (x−2, y−2)2228, and (x−2, y+2) 2227 having a quadrangular distribution based onthe base motion vector candidate (x, y) 2201 as a second candidategroup.

Also, the motion information decoder 2130 may determine predictionmotion vector candidates (x+4, y) 2210, (x−4, y) 2211, (x, y+4) 2212,and (x, y−4) 2213 having a diamond distribution based on the base motionvector candidate (x, y) 2201 as a third candidate group. A distributionshape of prediction motion vector candidates included in each candidategroup is not limited to that shown in FIG. 25, and may be any of variousother distribution shapes.

In an embodiment, the motion information decoder 2130 may determineprediction motion vector candidates located at different disparitydistances according to base motion vector candidates. For example, aprediction motion vector candidate having a disparity distance of 1 maybe determined for a first base motion vector candidate from among aplurality of base motion vector candidates, and a prediction motionvector candidate having a disparity distance of 2 may be determined fora second base motion vector candidate from among the plurality of basemotion vector candidates. Alternatively, for example, a predictionmotion vector candidate having a disparity distance of 1 and aprediction motion vector candidate having a disparity distance of 2 maybe determined for a first base motion vector candidate, and a predictionmotion vector candidate having a disparity distance of 4 and aprediction motion vector candidate having a disparity distance of 8 maybe determined for a second base motion vector candidate.

When disparity distances and base motion vector candidates are mapped toeach other in a 1:1 manner, the obtainer 2110 may obtain onlyinformation indicating a base motion vector of a current block orinformation indicating a disparity distance from a bitstream, and maydetermine a disparity distance for specifying a prediction motion vectorof the current block and the base motion vector of the current block.

As described above, a disparity distance for determining predictionmotion vector candidates may be determined based on a base pixel unit,and when a smallest pixel unit indicatable by a motion vector of acurrent block is different from the base pixel unit, the motioninformation decoder 2130 may scale a preset disparity distance forconfiguring a candidate group according to each base motion vectorcandidate.

When a motion vector of a current block may indicate pixelscorresponding to an integer pixel unit, a ½ pixel unit, a ¼ pixel unit,and a ⅛ pixel unit, a smallest pixel unit indicatable by the motionvector of the current block is a ⅛ pixel unit. When a base pixel unit isa ¼ pixel unit, the motion information decoder 2130 may up-scale adisparity distance for configuring a candidate group. In an example, themotion information decoder 2130 may up-scale the disparity distanceaccording to a ratio between the base pixel unit and the smallest pixelunit indicatable by the motion vector of the current block. When thesmallest pixel unit indicatable by the motion vector of the currentblock is an m pixel unit, the base pixel unit is an n pixel unit, andthe disparity distance corresponding to one candidate group is k, themotion information decoder 2130 may up-scale the disparity distance of kto k*n/m.

FIG. 26 illustrates prediction motion vector candidates determined aftera disparity distance described with reference to FIG. 22 is scaled, whena base pixel unit is a ¼ pixel unit and a smallest pixel unit of amotion vector of a current block is a ⅛ pixel unit.

Referring to FIG. 26, the motion information decoder 2130 may determineprediction motion vector candidates having a diamond distribution basedon a base motion vector candidate (x, y) 2601.

The motion information decoder 2130 may determine prediction motionvector candidates (x+2, y) 2602, (x−2, y) 2603, (x, y+2) 2604, and (x,y−2) 2605 at a scaled disparity distance of 2 (1*(¼)/(⅛)) from the basemotion vector candidate (x, y) 2601 as a first candidate group.

The motion information decoder 2130 may determine prediction motionvector candidates (x+4, y) 2606, (x−4, y) 2607, (x, y+4) 2608, and (x,y−4) 2609 at a scaled disparity distance of 4 (2*(¼)/(⅛)) from the basemotion vector candidate (x, y) 2601 as a second candidate group.

The motion information decoder 2130 may determine prediction motionvector candidates (x+8, y) 2610, (x−8, y) 2611, (x, y+8) 2612, and (x,y−8) 2613 at a scaled disparity distance of 8 (4*(¼)/(⅛)) from the basemotion vector candidate (x, y) 2601 as a third candidate group.

For a motion vector of a current block that may indicate a pixel unitdifferent from a base pixel unit, when prediction motion vectorcandidates are configured by scaling a pre-determined disparitydistance, the motion information decoder 2130 may also scale a disparitydistance corresponding to information obtained from a bitstream todetermine a prediction motion vector of the current block and then maydetermine the prediction motion vector of the current block according tothe scaled disparity distance. For example, when the prediction motionvector candidates are configured as shown in FIG. 26 and the disparitydistance checked from the bitstream is 1, the motion information decoder2130 may scale the checked disparity distance to 2 (1*(¼)/(⅛)) and maydetermine at least one from among the prediction motion vectorcandidates (x+2, y) 2602, (x−2, y) 2603, (x, y+2) 2604, and (x, y−2)2605 changed by the disparity distance of 2 from the base motion vector(x, y) as the prediction motion vector of the current block.

In an embodiment, when a smallest pixel unit indicatable by a basemotion vector candidate and a smallest pixel unit indicatable by amotion vector of a current block are different from each other, a motioninformation decoder may change the base motion vector candidateaccording to the smallest pixel unit indicatable by the motion vector ofthe current block, and may determine a prediction motion vectorcandidate according to a disparity distance from the changed base motionvector candidate.

In an example, when a smallest pixel unit indicatable by a base motionvector candidate is less than a smallest pixel unit indicatable by amotion vector of a current block, the base motion vector candidate maybe changed so that a pixel corresponding to the smallest pixel unitindicatable by the motion vector of the current block is indicated bythe base motion vector candidate.

FIG. 27 illustrates a method of changing, when a smallest pixel unitindicatable by a motion vector of a current block is a ¼ pixel unit anda pixel unit indicatable by a base motion vector candidate is a ⅛ pixelunit, the base motion vector candidate.

In FIG. 27, when a base motion vector candidate indicates a pixel of a ⅛pixel unit, the motion information decoder 2130 may change the basemotion vector candidate to indicate a pixel of a ¼ pixel unit around thepixel of the ⅛ pixel unit indicated by the base motion vector candidate.

In an example, the motion information decoder 2130 may change a basemotion vector candidate to indicate a pixel closest to a pixel P fromamong pixels a, b, c, d, e, and f of a ¼ pixel unit adjacent to thepixel P indicated by the base motion vector candidate. Alternatively,the motion information decoder 2130 may change the base motion vectorcandidate to indicate one pixel according to a predetermined criterionfrom among the pixels a, b, c, d, e, and f of the ¼ pixel unit adjacentto the pixel P indicated by the base motion vector candidate.

When the base motion vector candidate is changed, the motion informationdecoder 2130 may determine motion vectors spaced apart by a disparitydistance from the changed base motion vector candidate as predictionmotion vector candidates. When a smallest pixel unit indicatable by amotion vector of a current block is different from a base pixel unit,the motion information decoder 2130 may determine motion vectors spacedapart by a scaled disparity distance from the changed base motion vectorcandidate as prediction motion vector candidates.

FIG. 28 is a diagram for describing an index indicating predictionmotion vector candidates, according to an embodiment.

Referring to FIG. 28, reference numeral 2801 may denote a bitrepresentation corresponding to an index indicating a base motion vectorcandidate, reference numeral 2802 may denote a bit representationcorresponding to an index indicating a disparity distance (or acandidate group) of a prediction motion vector candidate, and referencenumerals 2803 and 2804 may denote a bit representation corresponding toan index indicating a disparity direction of the prediction motionvector candidate.

In order to determine a base motion vector of a current block based onan index indicating the base motion vector included in a bitstream, themotion information decoder 2130 may assign an index to each of one ormore base motion vector candidates. Also, the motion information decoder2130 may assign an index to each of prediction motion vector candidatesto determine a prediction motion vector of the current block based on anindex indicating a disparity distance included in the bitstream.

Referring to FIG. 28, an index of 0 may be assigned to a base motionvector candidate 0, and an index of 10 may be assigned to a base motionvector candidate 1. An index indicating each of the base motion vectorcandidates may be represented by using a unary coding method or atruncated unary coding method.

The number of bits representing an index may increase from the basemotion vector candidate 0 to a base motion vector candidate 4, and apriority between base motion vector candidates for assigning an indexmay be set by using the same criterion as that of the image encodingapparatus 3600.

In an embodiment, information indicating the priority between the basemotion vector candidates for assigning an index may be included in thebitstream, and in this case, the motion information decoder 2130 mayassign an index to each of the base motion vector candidates accordingto the information indicating the priority obtained from the bitstream.

The information indicating the priority between the base motion vectorcandidates obtained from the bitstream may include information about achanged priority number in comparison with the priority between the basemotion vector candidates determined in a previous block, a previousslice, or a previous picture. For example, when a priority number of thebase motion vector candidate 0 is 1 in the previous block, the previousslice, or the previous picture, but is changed to 3 in relation to acurrent block, a current slice, or a current picture, informationindicating that the priority number of the base motion vector candidate0 is changed to 3 may be included in the bitstream. Alternatively,information indicating that a priority between the base motion vectorcandidates determined in the previous block, the previous slice, or theprevious picture is not changed for the current block, the currentslice, or the current picture may be included in the bitstream.

Prediction motion vector candidates determined according to one basemotion vector candidate may be grouped into a candidate group accordingto a predetermined criterion. The predetermined criterion may be howmuch disparity distance the prediction motion vector candidates arespaced apart from the base motion vector candidate. An index of eachcandidate group may be represented by using a unary coding method or atruncated unary coding method. According to an embodiment, an index ofeach candidate group may be represented by using an FLC method.

Referring to FIG. 28, the number of bits for representing an index of acandidate group may increase from a candidate group 0 corresponding to afirst disparity distance to a candidate group 7 corresponding to aneighth disparity distance, and a priority between candidate groups forassigning an index may be set by using the same criterion as that of theimage encoding apparatus 3600.

In an embodiment, information indicating the priority between thecandidate groups for assigning an index may be included in thebitstream, and in this case, the motion information decoder 2130 mayassign an index to each of the candidate groups according to theinformation indicating the priority obtained from the bitstream. Theinformation indicating the priority between the candidate groupsobtained from the bitstream may include information about a changedpriority number in comparison with a priority between the candidategroups determined in a previous block, a previous slice, or a previouspicture. For example, when a priority number of the candidate group 0 is1 in the previous block, the previous slice, or the previous picture,but is changed to 3 in relation to a current block, a current slice, ora current picture, information indicating that the priority number ofthe candidate group 0 is changed to 3 may be included in the bitstream.Alternatively, information indicating that a priority between thecandidate groups determined in the previous block, the previous slice,or the previous picture is not changed for the current block, thecurrent slice, or the current picture may be included in the bitstream.

The candidate group 0 of FIG. 28 may include candidates spaced apart bya disparity distance of 1 from a base motion vector candidate, and in anembodiment, the candidate group 0 may include a candidate spaced apartby a distance of 0 from the base motion vector candidate. Because thecandidate spaced apart from a distance of 0 from the base motion vectorcandidate is the base motion vector candidate itself, as described withreference to FIGS. 22 through 25, when the base motion vector candidatecorresponds to (x, y), a prediction motion vector candidate becomes (x,y). In this case, when information indicating a candidate group forspecifying a prediction motion vector of a current block indicates thecandidate group 0, without needing to obtain information indicating adisparity direction, a base motion vector of the current block may bedetermined as the prediction motion vector of the current block. Whenone base motion vector is determined for the current block andinformation indicating a candidate group indicates the candidate group0, unless there is a differential motion vector, the base motion vectoris to be a motion vector of the current block, and thus a merge mode ora skip mode of conventional HEVC may be replaced.

An index (or a flag) indicating a disparity direction may be assigned toprediction motion vector candidates included in one candidate group. Inthis case, the index indicating the disparity direction may berepresented by using an FLC method. For example, when four predictionmotion vector candidates are included in one candidate group, two bitsmay be assigned to indicate each of the four prediction motion vectorcandidates.

The motion information decoder 2130 may classify prediction motionvector candidates included in one candidate group into groups accordingto locations in a coordinate plane, and may assign an index or a flagcorresponding to each of the classified groups.

Referring to FIG. 28, according to whether prediction motion vectorcandidates (x+1, y), (x−1, y), (x, y+1), and (x, y−1) corresponding tothe candidate group 0 of the base motion vector candidate 0 are changedfrom the base motion vector candidate 0 in an x-axis direction or ay-axis direction, an index (or a flag) of 0 or 1 may be assigned asshown in the bit representation 2803, and according to whether theprediction motion vector candidates (x+1, y), (x−1, y), (x, y+1), and(x, y−1) are changed in a + direction or a − direction, an index (or aflag) of 0 or 1 may be assigned as shown in the bit representation 2804.

In an embodiment, the obtainer 2110 may entropy decode a bit valueincluded in the bitstream according to a predetermined context model, inorder to obtain at least one from among information indicating adisparity distance and information indicating a disparity direction forspecifying a prediction motion vector of a current block.

When two candidate groups corresponding to two disparity distances areconfigured for one base motion vector candidate, the obtainer 2110 mayentropy decode a bit value included in a bitstream according to apredetermined context model, in order to obtain information indicating adisparity distance of a prediction motion vector of a current block. Inthis case, the information indicating the disparity distance may bebinarized according to an FLC method, and then may be entropy encodedand may be included in the bitstream.

In an embodiment, the obtainer 2110 may decode at least one of indexesindicating a disparity direction from a bitstream by using a contextmodel. For example, the obtainer 2110 may divide four prediction motionvector candidates included in one candidate group into two groupsincluding two candidates changed in an x-axis direction and twocandidates changed in a y-axis direction based on a base motion vectorcandidate, and may decode, according to a context model, an index (2803)indicating whether a candidate is changed in the x-axis direction or they-axis direction. When it is determined that the candidate is changed inthe x-axis direction or the y-axis direction, the obtainer 2110 maydecode, according to a context model, an index (2804) indicating whetherthe candidate is changed in the + direction or the − direction.

In an embodiment, the motion information decoder 2130 may cause only acandidate located at a preset point in a coordinate plane to be includedin each candidate group. For example, the motion information decoder2130 may cause only candidates changed in an x-axis or a y-axis to beincluded in each candidate group, based on information about at leastone of a previous picture, a current picture, a previous slice, acurrent slice, a previous block, and a current block. For example, fromamong candidates (x+1, y), (x−1, y), (x, y+1), and (x, y−1) included inthe candidate group 0 of FIG. 28, only the candidates (x+1, y) and (x−1,y) changed along the x-axis may be included in the candidate group 0,and an index corresponding to the bit representation 2804 may beassigned to each candidate to divide the candidates (x+1, y) and (x−1,y) and may be decoded according to a context model.

In an embodiment, when two base motion vector candidates of a currentblock are determined, the obtainer 2110 may obtain informationindicating a base motion vector of the current block by entropy decodinga bit value included in a bitstream according to a predetermined contextmodel. In this case, the information indicating the base motion vectormay be binarized according to an FLC method, and then may be entropyencoded and may be included in the bitstream.

In an embodiment, when at least one from among the informationindicating the base motion vector, information indicating a disparitydistance, and information indicating a disparity direction is to beobtained by entropy decoding the bit value included in the bitstream,the obtainer 2110 may select a context model for at least one from amongthe information indicating the base motion vector, the informationindicating the disparity distance, and the information indicating thedisparity direction from among one or more context models based oninformation related to neighboring blocks adjacent to the current block.

The neighboring blocks may include, but are not limited to, a left blockadjacent to a left side of the current block and an upper block adjacentto an upper side of the current block.

The obtainer 2110 may select a context model based on informationrelated to a neighboring block decoded by applying the same mode as apreset mode applied to the current block from among the neighboringblocks adjacent to the current block.

In an example, the obtainer 2110 may select a context model for thecurrent block based on the information related to the neighboring blockto which the same mode as the preset mode applied to the current blockis applied, e.g., at least one of the information indicating the basemotion vector, the information indicating the disparity distance, andthe information the disparity direction.

In an embodiment, when sizes of a motion vector of the upper block towhich the preset mode is applied and a motion vector of the left blockto which the preset mode is applied in the x-axis direction are greaterthan a reference value, the obtainer 2110 may select a first contextmodel. Also, when a size of a motion vector of the left block to whichthe preset mode is applied in the x-axis direction is greater than areference value or a size of a motion vector of the upper block to whichthe preset mode is applied in the x-axis direction is greater than areference value, the obtainer 2110 may select a second context model.Also, when sizes of a motion vector of the upper block to which thepreset mode is applied and a motion vector of the left block to whichthe preset mode is applied in the x-axis direction are equal to or lessthan a reference value, the obtainer 2110 may select a third contextmodel.

A method of determining a prediction motion vector candidate when a basemotion vector candidate is a bi-directional motion vector will bedescribed.

First, FIG. 29 for describing motion information used for bi-directionalprediction of a block illustrates a case where a block isbi-directionally predicted in an AMVP mode of HEVC.

A block 2910 may be uni-directionally predicted by using a referencepicture 2930 included in a list 0 or a reference picture 2950 includedin a list 1, or may be bi-directionally predicted by using two referencepictures 2930 and 2950 included in the list 0 and the list 1.

Referring to FIG. 29, when a prediction direction of the block 2910 is auni-direction of a list 0 direction, a motion vector MV0 of the list 0direction of the block 2910 is determined based on a prediction motionvector MVP0 corresponding to the list 0 direction and a differentialmotion vector MVD0 for the list 0 direction. When a prediction directionof the block 2910 is a uni-direction of a list 1 direction, a motionvector MV1 of the list 1 direction of the block 2910 is determined basedon a prediction motion vector MVP1 corresponding to the list 1 directionand a differential motion vector MVD1 for the list 1 direction.

When a prediction direction of the block 2910 is a bi-directionincluding the list 0 direction and the list 1 direction, the motionvector MV0 of the list 0 direction of the block 2910 is determined basedon the prediction motion vector MVP0 corresponding to the list 0direction and the differential motion vector MVD0 for the list 0direction, and the motion vector MV1 of the list 1 direction of theblock 2910 is determined based on the prediction motion vector MVP1corresponding to the list 1 direction and the differential motion vectorMVD1 for the list 1 direction.

That is, when a block is bi-directionally predicted, it may mean that amotion vector of the block includes a motion vector of the list 0direction and a motion vector of the list 1 direction, and may mean thata prediction motion vector of the block includes a prediction motionvector of the list 0 direction and a prediction motion vector of thelist 1 direction.

In an embodiment of the present disclosure, when one base motion vectorcandidate corresponds to a bi-directional motion vector, the base motionvector candidate includes a base motion vector candidate of the list 0direction and a base motion vector candidate of the list 1 direction,and a method of determining a prediction motion vector candidate for thelist 0 direction and a prediction motion vector candidate for the list 1direction will be described.

FIG. 30 illustrates, when a base motion vector candidate corresponds toa bi-directional motion vector, a positional relationship among a firstreference picture 3030 indicated by a base motion vector candidate of afirst uni-direction, a second reference picture 3050 indicated by a basemotion vector candidate of a second uni-direction, and a current picture3010 including a current block. In FIG. 30, it is assumed that adistance between the current picture 3010 and the first referencepicture 3030 is d1, and a distance between the current picture 3010 andthe second reference picture 3050 is d2. A distance between pictures mayrefer to a POC value difference between the pictures. Also, the firstuni-direction refers to a list 0 direction or a list 1 direction, andthe second uni-direction refers to a direction different from the firstuni-direction.

Referring to FIG. 30, the current picture 3010 has a POC B, and thefirst reference picture 3030 and the second reference picture 3050respectively have a POC A and a POC C. Prediction motion vectorcandidates when the POC B has a value between the POC A and the POC Care illustrated in FIG. 31.

Although prediction motion vector candidates of FIG. 28 include acandidate for a list 0 or a candidate for a list 1 according to adirection of a base motion vector candidate, when a base motion vectorcandidate is bi-directional, each prediction motion vector candidate mayinclude a candidate for the list 0 and a candidate for the list 1.

When the POC B has a value between the POC A and the POC C, each ofprediction motion vector candidates classified according to a disparitydistance and a disparity direction may include a prediction motionvector candidate for the first uni-direction having a value of a sizecorresponding to the disparity distance (or a size corresponding to ascaled disparity distance) and a prediction motion vector candidate forthe second uni-direction having a value of the opposite sign and a sizecorresponding to the disparity distance (or a size corresponding to thescaled disparity distance).

For example, in FIG. 31, a prediction motion vector candidate specifiedby an index 00 indicating a disparity direction from among predictionmotion vector candidates included in a candidate group 0 may include(x+1, y) having a value of a size corresponding to a disparity distance(or a size corresponding to a scaled disparity distance) as a componentand (x−1, y) (n is 1) having a value of the opposite sign as acomponent. (x+1, y) may correspond to a prediction motion vectorcandidate for the first uni-direction, and (x−1, y) may correspond to aprediction motion vector candidate for the second uni-direction. Whenthe index 00 indicating the disparity direction is obtained from abitstream, the motion information decoder 2130 may determine (x+1, y) asthe prediction motion vector for the first uni-direction of the currentblock, and may determine (x−1, y) as the prediction motion vector forthe second uni-direction of the current block.

Here, n shown in FIG. 31 is a scaling factor for a disparity distanceand is determined according to a distance between d1 and d2. Forexample, when a prediction motion vector candidate for the firstuni-direction in the case where d1 is 1 is (x+1, y), a prediction motionvector candidate for the second uni-direction in the case where d2 is 2may be determined to be (x−1*2, y).

In an example, n (=d2/d1) may be calculated as an integer (int) type, oraccording to an embodiment, may be calculated as a double type or afloat type. Alternatively, according to an embodiment, n may beconverted through a bit shift operator (<<, >>), may be rounded, andthen may be calculated by applying again a bit shift operator.

FIG. 31 illustrates that n (=d2/d1) is applied to determine a predictionmotion vector candidate for the second uni-direction, which maycorrespond to a case where d2 is greater than d1. When d1 is greaterthan d2, n (=d1/d2) may be applied to determine a prediction motionvector candidate for the first uni-direction. For example, theprediction motion vector candidate specified by the index 00 in thecandidate group 0 in FIG. 31 may include (x+1*n, y) that is a predictionmotion vector candidate for the first uni-direction and (x−1, y) that isa prediction motion vector candidate for the second uni-direction.

FIG. 32 illustrates, when a base motion vector candidate corresponds toa bi-directional motion vector, a positional relationship among a firstreference picture 3230 indicated by a base motion vector candidate of afirst uni-direction, a second reference picture 3250 indicated by a basemotion vector candidate of a second uni-direction, and a current picture3210 including a current block. In FIG. 32, it is assumed that adistance between the current picture 3210 and the first referencepicture 3230 is d1, and a distance between the current picture 3210 andthe second reference picture 3250 is d2.

Referring to FIG. 32, the current picture 3210 has a POC A, and thefirst reference picture 3230 and the second reference picture 3250respectively have a POC B and a POC C. Prediction motion vectorcandidates when the POC A is less than the POC B and the POC C areillustrated in FIG. 33. Prediction motion vector candidates when the POCA is greater than the POC B and the POC C may be the same as those inFIG. 33.

Each of prediction motion vector candidates classified according to adisparity distance and a disparity direction may include a candidate forthe first uni-direction and a candidate for the second uni-direction.

When the POC A is greater or less than the POC B and the POC C, each ofprediction motion vector candidates classified according to a disparitydistance and a disparity direction may include a prediction motionvector candidate for the first uni-direction having a value of a sizecorresponding to the disparity distance (or a size corresponding to ascaled disparity distance) and a prediction motion vector candidate forthe second uni-direction having a value of the same sign and a sizecorresponding to the disparity distance (or a size corresponding to thescaled disparity distance) as a component.

For example, referring to FIG. 32, a prediction motion vector candidatespecified by an index 00 indicating a disparity direction from amongprediction motion vector candidates included in a candidate group 0 mayinclude a prediction motion vector candidate (x+1, 0) for the firstuni-direction and a prediction motion vector candidate (x+1, 0) (n is 1)for the second uni-direction having a value of a size corresponding to adisparity distance (or a size corresponding to a scaled disparitydistance).

Here, n is a scaling factor for a disparity distance and is determinedaccording to a distance between d1 and d2. For example, when aprediction motion vector candidate for the first uni-direction in thecase where d1 is 1 is (1, 0), a prediction motion vector candidate forthe second uni-direction in the case where d2 is 2 may be determined tobe (1*2, 0).

In an example, n (=d2/d1) may be calculated as an integer (int) type, oraccording to an embodiment, may be calculated as a double type or afloat type. Alternatively, according to an embodiment, n may beconverted through a bit shift operator (<<, >>), may be rounded, andthen may be calculated by applying again a bit shift operator.

FIG. 33 illustrates that n (=d2/d1) is applied to determine a predictionmotion vector candidate for the second uni-direction, which maycorrespond to a case where d2 is greater than d1. When d1 is greaterthan d2, n (=d1/d2) may be applied to determine a prediction motionvector candidate for the first uni-direction. For example, theprediction motion vector candidate specified by the index 00 in thecandidate group 0 in FIG. 33 may include (x+1*n, y) that is a predictionmotion vector candidate for the first uni-direction and (x+1, y) that isa prediction motion vector candidate for the second uni-direction.

Regarding the scaling factor n shown in each of FIGS. 31 and 33, when adisparity distance before being scaled is a, a base pixel unit is p1, asmallest pixel unit of a motion vector of a current block is p2, and d2is greater than d1, the scaling factor n may be calculated asint((a*p1/p2+½)/d1)*d2. In contrast, when d1 is greater than d2, thescaling factor n may be calculated as int((a*p1/p2+½)/d2)*d1.

A method of determining a motion vector of a current block inconsideration of a prediction direction of the current block and adirection of a base motion vector will be described.

In an embodiment, the obtainer 2110 may extract information indicating ause direction of the base motion vector, e.g., an index, from abitstream. The information indicating the use direction of the basemotion vector may correspond to the prediction direction of the currentblock.

In an example, when the use direction of the base motion vector is alist 0 direction, the current block may be subjected to uni-directionalprediction of the list 0 direction, and when the use direction of thebase motion vector is a list 1 direction, the current block may besubjected to uni-directional prediction of the list 1 direction. Also,when the use direction of the base motion vector is a bi-direction, thecurrent block may be subjected to bi-directional prediction.

For example, when the base motion vector is bi-directional, a bit value0 may indicate that the use direction of the base motion vector is thebi-direction, a bit value 10 may indicate that the use direction of thebase motion vector is the list 0 direction, and a bit value 11 mayindicate that the use direction of the base motion vector is the list 1direction.

Also, for example, when the base motion vector is in a firstuni-direction of the list 0 direction or the list 1 direction, the bitvalue 0 may indicate that the use direction of the base motion vector isthe first uni-direction, the bit value 10 may indicate that the usedirection of the base motion vector is a second uni-direction differentfrom the first uni-direction, and the bit value 11 may indicate that theuse direction of the base motion vector is the bi-direction.

The use direction of the base motion vector corresponding to the bitvalue may also be changed.

When a base motion vector is bi-directional and a use direction of thebase motion vector is a bi-direction

The motion information decoder 2130 may determine a motion vector of alist 0 direction of a current block by using a prediction motion vectorcorresponding to a disparity distance and a disparity direction for thelist 0 direction. The motion information decoder 2130 may determine themotion vector of a list 1 direction of the current block by using theprediction motion vector corresponding to the disparity distance and thedisparity direction for the list 1 direction.

When a base motion vector is bi-directional, a use direction of the basemotion vector is a bi-direction, and only information indicating thedisparity distance and the disparity direction for the list 0 directionis included in a bitstream, the motion information decoder 2130 maydetermine the disparity distance and the disparity direction for thelist 1 direction based on the information indicating the disparitydistance and the disparity direction for the list 0 direction.

The motion information decoder 2130 may determine the disparity distanceand the disparity direction for the list 1 direction, in considerationof a positional relationship among a reference picture corresponding tothe base motion vector of the list 0 direction, a current pictureincluding the current block, and a reference picture corresponding tothe base motion vector of the list 1 direction.

In an example, when the current picture is located between the referencepicture of the list 0 direction and the reference picture of the list 1direction, the motion information decoder 2130 may determine thedisparity distance and the disparity direction for the list 1 directionby changing the disparity direction for the list 0 direction to theopposite and scaling a value of the disparity distance for the list 0direction according to a ratio between d1 (a distance between thecurrent picture and the reference picture of the list 0 direction) andd2 (a distance between the current picture and the reference picture ofthe list 1 direction). For example, when a prediction motion vector forthe list 0 direction is (x+1, y+1), d1 is 1, and d2 is 2, the predictionmotion vector for the list 1 direction may be determined to be (x−2,y−2).

In another example, when the current picture is located before or afterthe reference picture of the list 0 direction and the reference pictureof the list 1 direction, the motion information decoder 2130 maydetermine the disparity distance and the disparity direction for thelist 1 direction by maintaining the disparity direction for the list 0direction and scaling the disparity distance for the list 0 directionaccording to a ratio between d1 and d2. For example, when the predictionmotion vector for the list 0 direction is (x+1, y+1), d1 is 1, and d2 is2, the prediction motion vector for the list 1 direction may bedetermined to be (x+2, y+2).

When a base motion vector is bi-directional and a use direction of thebase motion vector is a uni-direction

When a base motion vector is bi-directional, and a use direction of thebase motion vector is a list 0 direction or a list 1 direction, themotion information decoder 2130 may obtain information indicating adisparity distance and a disparity direction for the list 0 direction orthe list 1 direction from a bitstream, and may determine a motion vectorof a current block of the list 0 direction or the list 1 direction byusing a prediction motion vector corresponding to the obtainedinformation.

When the use direction of the base motion vector is a firstuni-direction but only information indicating the disparity distance andthe disparity direction for a second uni-direction is included in abitstream, the motion information decoder 2130 may determine thedisparity distance and the disparity direction for the firstuni-direction from the disparity distance and the disparity directionfor the second uni-direction in consideration of a positionalrelationship and a distance among a current picture, a reference pictureof the list 0 direction, and a reference picture of the list 1 directionas described above.

When a base motion vector is uni-directional and a use direction of thebase motion vector is a uni-direction

When a base motion vector is in a first uni-direction of a list 0direction or a list 1 direction, a use direction of the base motionvector is a second uni-direction different from the first uni-direction,and only information indicating a disparity distance and a disparitydirection for the first uni-direction is included in a bitstream, themotion information decoder 2130 may determine the base motion vector ofthe second uni-direction based on the base motion vector of the firstuni-direction, and may determine the disparity distance and thedisparity direction for the second uni-direction based on the disparitydistance and the disparity direction for the first uni-direction.

First, the motion information decoder 2130 may determine a secondreference picture located in a direction opposite to the first referencepicture based on a current picture, in consideration of d1 (a distancebetween the current picture and the first reference picture indicated bythe base motion vector of the first uni-direction).

In an example, the second reference picture spaced apart by the samedistance as d1 may be determined. In this case, because d1 and d2 (adistance between the current picture and the second reference picture)are the same and the current picture is located between the firstreference picture and the second reference picture, the motioninformation decoder 2130 may generate the base motion vector of thesecond uni-direction by changing the sign of the base motion vector ofthe first uni-direction to the opposite, and may determine the disparitydirection for the second uni-direction by changing the disparitydirection for the first uni-direction to the opposite. The disparitydistance for the first uni-direction may be determined as the disparitydistance for the second uni-direction.

When there is no picture spaced apart by the same distance as d1, apicture located in a direction opposite to the first reference picturebased on the current picture while being located closest to the currentpicture may be determined as the second reference picture. In this case,although the current picture is located between the first referencepicture and the second reference picture, d1 and d2 are different fromeach other. The motion information decoder 2130 may generate the basemotion vector of the second uni-direction by changing the sign of thebase motion vector of the first uni-direction to the opposite andscaling the base motion vector of the first uni-direction according to aratio between d1 and d2. Also, the motion information decoder 2130 maydetermine the disparity distance and the disparity direction for thesecond uni-direction by changing the disparity direction of the firstuni-direction to the opposite and scaling the disparity distance for thefirst uni-direction according to a ratio between d1 and d2.

When the current picture corresponds to a last picture of a group ofpictures (GOP), the motion information decoder 2130 may determine onepicture located in the same direction as the first reference pictureabout the current picture as the second reference picture. A pictureclosest to the first reference picture or the current picture may bedetermined as the second reference picture. In this case, because thecurrent picture is located after the first reference picture and thesecond reference picture, the motion information decoder 2130 maygenerate the base motion vector of the second uni-direction by scaling avalue of the base motion vector of the first uni-direction (withoutchanging the sign) according to a ratio between d1 and d2. Also, themotion information decoder 2130 may determine the disparity distance forthe second uni-direction by scaling the disparity distance for the firstuni-direction according to a ratio between d1 and d2.

In an example, when the current picture corresponds to a last picture ofa GOP and the first reference picture itself is determined as the secondreference picture, the motion information decoder 2130 may determine thebase motion vector of the first uni-direction as the base motion vectorof the second uni-direction, and may determine the disparity distanceand the disparity direction for the first uni-direction as the disparitydistance and the disparity direction for the second uni-direction.

When a prediction motion vector for the second uni-direction isdetermined, the motion information decoder 2130 may determine a motionvector of the second uni-direction of the block by using the predictionmotion vector of the second uni-direction.

When a base motion vector is uni-directional and a use direction of thebase motion vector is a bi-direction

When a base motion vector is in a first uni-direction of a list 0direction or a list 1 direction, a use direction of the base motionvector is a bi-direction, and only information indicating a disparitydistance and a disparity direction for the first uni-direction isincluded in a bitstream, the motion information decoder 2130 maygenerate the base motion vector of a second uni-direction based on thebase motion vector of the first uni-direction, and may determine adisparity distance and a disparity direction for the seconduni-direction based on the disparity distance and the disparitydirection for the first uni-direction.

First, the motion information decoder 2130 may determine a secondreference picture located in a direction opposite to the first referencepicture based on a current picture, in consideration of d1 (a distancebetween the current picture and the first reference picture indicated bythe base motion vector of the first uni-direction).

In an example, the second reference picture spaced apart by the samedistance as d1 may be determined. In this case, because d1 and d2 (adistance between the current picture and the second reference picture)are the same and the current picture is located between the firstreference picture and the second reference picture, the motioninformation decoder 2130 may generate the base motion vector of thesecond uni-direction by changing the sign of the base motion vector ofthe first uni-direction to the opposite, and may determine a disparitydirection for the second uni-direction by changing the disparitydirection for the first uni-direction to the opposite. The disparitydistance for the first uni-direction may be determined as the disparitydistance for the second uni-direction.

When there is no picture spaced apart by the same distance as d1, apicture located in a direction opposite to the first reference picturebased on the current picture while being closest to the current picturemay be determined as the second reference picture. In this case,although the current picture is located between the first referencepicture and the second reference picture, d1 and d2 are different fromeach other. The motion information decoder 2130 may generate the basemotion vector of the second uni-direction by changing the sign of thebase motion vector of the first uni-direction to the opposite andscaling the base motion vector of the first uni-direction according to aratio between d1 and d2. Also, the motion information decoder 2130 maydetermine a disparity direction for the second uni-direction by changingthe disparity direction for the first uni-directional to the opposite,and may determine a disparity distance for the second uni-direction byscaling the disparity distance for the first uni-direction according toa ratio between d1 and d2.

When the current picture corresponds to a last picture of a GOP, themotion information decoder 2130 may determine a picture located in thesame direction as the first reference picture about the current pictureas the second reference picture. A picture closest to the firstreference picture or the current picture may be determined as the secondreference picture. In this case, because the current picture is locatedafter the first reference picture and the second reference picture, themotion information decoder 2130 may generate the base motion vector ofthe second uni-direction by scaling a value of the base motion vector ofthe first uni-direction (without changing the sign) according to a ratiobetween d1 and d2. Also, the motion information decoder 2130 maygenerate a disparity distance for the second uni-direction by scalingthe disparity distance for the first uni-direction according to a ratiobetween d1 and d2.

In an example, when the current picture corresponds to a last picture ofa GOP and the first reference picture is determined as the secondreference picture, the motion information decoder 2130 may determine thebase motion vector of the first uni-direction as the base motion vectorof the second uni-direction, and may determine the disparity distanceand the disparity direction for the first uni-direction as the disparitydistance and the disparity direction for the second uni-direction.

When the prediction motion vector of the second uni-direction isgenerated, the motion information decoder 2130 may determine a motionvector of the second uni-direction of the current block based on theprediction motion vector of the second uni-direction, and may determinethe motion vector of the first uni-direction of the current block basedon the prediction motion vector of the first uni-direction.

In an embodiment, the obtainer 2110 may obtain, from a bitstream,information indicating whether a current block is multi-pass coded andinformation about a prediction mode applied to the current block whenmulti-pass coding is applied. The term ‘multi-pass coding’ may refer toa method of encoding a block in two different prediction modes and thenfinally selecting a prediction mode with higher efficiency to encode ablock.

When it is checked that the current block is multi-pass coded, theobtainer 2110 may obtain information, e.g., a flag, indicating aprediction mode, in which the current block is encoded, from among thetwo prediction modes.

When it is checked that the current block to which multi-pass coding isapplied is encoded in a preset mode according to the present disclosure,the motion information decoder 2130 may decode motion information of thecurrent block based on information indicating a base motion vector ofthe current block and information indicating a prediction motion vector.When it is checked that the current block that is multi-pass coded isencoded in a mode other than the preset mode, e.g., a merge mode, a skipmode, a direct mode, or an AMVP mode, the motion information decoder2130 may decode the motion information according to the checked mode.

The current block according to the present disclosure may correspond toa first child block split from a parent block. When informationindicating that the parent block is split is included in the bitstream,the motion information decoder 2130 may split the parent block into thefirst child block corresponding to the current block and a second childblock. Alternatively, the motion information decoder 2130 may split theparent block into the first child block corresponding to the currentblock and the second child block in consideration of at least one of asize, a horizontal length, and a vertical length of the parent block.For example, when the horizontal length of the parent block is greaterthan the vertical length, the motion information decoder 2130 maydetermine two child blocks by halving the horizontal length of theparent block, and when the vertical length of the parent block isgreater than the horizontal length, the motion information decoder 2130may determine two child blocks by halving the vertical length of theparent block. The parent block may refer to a basic block for predictionsuch as a prediction unit of HEVC. According to an embodiment, themotion information decoder 2130 may split the parent block into thefirst child block corresponding to the current block, the second childblock, and a third child block, that is, three child blocks.

Also, shapes of the child blocks may include not only a square shape ora rectangular shape but also a triangular shape or a trapezoidal shape.

When the preset mode according to the present disclosure is applied tothe first child block, the motion information decoder 2130 may determinea motion vector of the first child block according to theabove-described methods.

In order to determine a motion vector of the second child block, likefor the first child block, the motion information decoder 2130 maydetermine the base motion vector of the second child block and theprediction motion vector of the second child block based on theinformation indicating the base motion vector and the informationindicating the prediction motion vector obtained from the bitstream, andmay determine the motion vector of the second child block based on theprediction motion vector. In this case, base motion vector candidatesand prediction motion vector candidates determined for the parent blockmay also be used for the first child block and the second child block.In other words, the base motion vector candidates and the predictionmotion vector candidates may be determined at a parent block level, andthe motion vector of the first child block may be determined based onthe information indicating the base motion vector and the informationindicating the prediction motion vector of the first child block, andthe motion vector of the second child block may be determined based onthe information indicating the base motion vector and the informationindicating the prediction motion vector of the second child block.

As another example, the motion vector determined for the first childblock may be determined as the base motion vector of the second childblock, and only information indicating the prediction motion vector ofthe second child block may be obtained to determine the predictionmotion vector of the second child block. The motion information decoder2130 may determine the motion vector of the second child block based onthe prediction motion vector of the second child block.

As another example, at least one from among information indicating thebase motion vector, information indicating a disparity distance, andinformation indicating a disparity direction, obtained from thebitstream in relation to the first child block, may be shared with thesecond child block. In this case, the motion information decoder 2130may determine the prediction motion vector of the second child blockbased on the information shared with the second child block from amongthe information indicating the base motion vector, the informationindicating the disparity distance, and the information indicating thedisparity direction which are obtained from the bitstream in relation tothe first child block, and remaining information obtained from abitstream in relation to the second child block.

Also, information indicating a differential motion vector may beincluded in only the bitstream related to one block from among the firstchild block and the second child block. For example, when thedifferential motion vector is determined in relation to the first childblock, the motion information decoder 2130 may also apply thedifferential motion vector of the first child block to the second childblock.

In an embodiment, the first child block may be encoded in the presetmode according to the present disclosure, and the second child block maybe encoded in a mode different from the preset mode applied to the firstchild block. In this case, the motion information decoder 2130 maydecode the first child block and the second child block according to themodes respectively applied to the first child block and the second childblock.

When the motion vectors of the first child block and the second childblock are determined, a first prediction block corresponding to thefirst child block and a second prediction block corresponding to thesecond child block may be determined through inter prediction. Smoothingfiltering may be performed on a boundary between the first predictionblock and the second prediction block, a residual block may be added toa final prediction block generated as a filtering result, and the parentblock may be finally reconstructed. For the smoothing filtering, anN-tap filter may be used or an overlapped block motion compensation(OBMC) method may be used. A weight may be applied to an overlappedportion between the first prediction block and the second predictionblock according to the OBMC method. Although a weight of a boundaryregion may be 0.5:0.5, a weight may increase as a region is farther awayfrom a boundary.

FIG. 34 illustrates a process, performed by the image decoding apparatus2100, of parsing a bitstream, according to an embodiment.

First, when a skip flag indicating whether a skip mode is applied to acurrent block indicates 1 or a direct flag indicating whether a directmode is applied to the current block indicates 1, the image decodingapparatus 2100 parses a UMVE flag indicating whether a preset modeaccording to the present disclosure is applied to the current block.When the skip flag is 1, a skip mode is applied to the current block,and when the direct flag is 1, a direct mode is applied to the currentblock.

When identical_list0_list1 flag is not 1, GROUP IDX is parsed.identical_list0_list1 flag may be set to 1 when reference picturesincluded in a list 0 and reference pictures included in a list 1 are thesame. Also, GROUP IDX denotes a use direction of a base motion vector.

When identical_list0_list1 flag is 1, GROUP IDX is set to 0. In anembodiment, when GROUP IDX is 0, it may mean that the use direction ofthe base motion vector is the same as a direction of the base motionvector. For example, when the base motion vector is bi-directional andGROUP IDX is 0, the use direction of the base motion vector may also bea bi-direction. The use direction of the base motion vector may be setas a prediction direction of the current block.

Next, the image decoding apparatus 2100 may parse Base candidate IDXindicating a base motion vector of the current block, and may parseDistance IDX indicating a disparity distance of a prediction motionvector of the current block and Direction IDX indicating a disparitydirection of the prediction motion vector.

The image decoding apparatus 2100 may determine a motion vector of thecurrent block based on GROUP IDX, Base candidate IDX, Distance IDX, andDirection IDX

In an embodiment, the base motion vector corresponding to Base candidateIDX, the disparity distance corresponding to Distance IDX, and thedisparity direction corresponding to Direction IDX may be as shown inTables 1, 2, and 3.

TABLE 1 Base candidate IDX 0 1 2 3 N^(th) MVP 1^(st) MVP 2^(nd) MVP3^(rd) MVP 4^(th) MVP

TABLE 2 Distance IDX 0 1 2 3 4 5 6 7 Variance distance 1 2 4 8 16 32 64128

TABLE 3 Direction IDX 00 01 10 11 x-axis + − N/A N/A y-axis N/A N/A + −

In Table 1, Base candidate IDX of 0 indicates a first base motion vectorcandidate from among base motion vector candidates, and Base candidateIDX of 1 indicates a second base motion vector candidate from among thebase motion vector candidates.

In Table 2, the disparity distance corresponding to Distance IDX isdetermined based on a base pixel unit, and the disparity distance of 1corresponding to Distance IDX 0 may indicate a ¼ pixel distance, and thedisparity distance of 2 corresponding to Distance IDX 1 may indicate a ½pixel distance. As described above, when a smallest pixel unitindicatable by the motion vector of the current block is less than thebase pixel unit, the disparity distance may be scaled according to aratio between the smallest pixel unit and the base pixel unit. Forexample, when the base pixel unit is a ¼ pixel unit and the smallestpixel unit is a ⅛ pixel unit, and an index indicating the disparitydistance obtained from the bitstream is 0, the disparity distance of 1corresponding to the index 0 may be up-scaled to 2.

Also, in Table 3, Direction IDX of 00 indicates the prediction motionvector changed in an x-axis direction and a + direction based on thebase motion vector, and Direction IDX of 11 indicates the predictionmotion vector changed in a y-axis direction and a − direction based onthe base motion vector.

FIG. 35 is a flowchart for describing an image decoding method accordingto an embodiment.

In operation S3510, the image decoding apparatus 2100 obtainsinformation indicating a disparity distance for determining a predictionmotion vector of a current block. The disparity distance may be a valuedetermined based on a base pixel unit.

The image decoding apparatus 2100 may obtain the information indicatingthe disparity distance for determining the prediction motion vector ofthe current block from a bitstream. Alternatively, the image decodingapparatus 2100 may directly determine the disparity distance fordetermining the prediction motion vector of the current block based oninformation related to at least one of the current block, a previouslydecoded block, a current slice, a previously decoded slice, a currentpicture, and a previously decoded picture.

As described above, before the information indicating the disparitydistance for determining the prediction motion vector of the currentblock is obtained, the image decoding apparatus 2100 may determine oneor more prediction motion vector candidates changed according to apre-determined disparity distance (or a disparity distance scaledaccording to a smallest pixel unit from the pre-determined disparitydistance) and a pre-determined disparity direction from each of one ormore base motion vector candidates of the current block.

In operation S3520, the image decoding apparatus 2100 scales thedisparity distance, based on a comparison result of the base pixel unitand the smallest pixel unit indicatable by a motion vector of thecurrent block.

When the base pixel unit and the smallest pixel unit indicatable by themotion vector of the current block are the same, the image decodingapparatus 2100 may not scale the disparity distance, and when thesmallest pixel unit indicatable by the motion vector of the currentblock is less than the base pixel unit, the image decoding apparatus2100 may up-scale the disparity distance.

In operation S3530, the image decoding apparatus 2100 determines aprediction motion vector candidate changed by the scaled disparitydistance from the base motion vector of the current block from among theone or more prediction motion vector candidates as the prediction motionvector of the current block.

Due to a difference between the base pixel unit and the smallest pixelunit, when the one or more prediction motion vector candidates aredetermined by scaling the pre-determined disparity distance, the imagedecoding apparatus 2100 may also scale the disparity distance obtainedto determine the prediction motion vector of the current block, and thenmay determine the prediction motion vector of the current block.

In operation S3540, the image decoding apparatus 2100 may determine themotion vector of the current block by using the prediction motion vectorof the current block.

When information indicating a differential motion vector is included inthe bitstream, the image decoding apparatus 2100 may determine themotion vector of the current block by applying the differential motionvector to the prediction motion vector.

FIG. 36 is a block diagram of the image encoding apparatus 3600according to an embodiment.

Referring to FIG. 36, the image encoding apparatus 3600 according to anembodiment may include a motion information encoder 3610 and a generator3630.

The image encoding apparatus 3600 may encode an image, and may generatea bitstream including information generated as an encoding result.

The image encoding apparatus 3600 according to an embodiment may includea central processor (not shown) for controlling the motion informationencoder 3610 and the generator 3630. Alternatively, the motioninformation encoder 3610 and the generator 3630 may be operated by theirown processors (not shown), and the image encoding apparatus 3600 mayoperate as the processors (not shown) organically operate.Alternatively, the motion information encoder 3610 and the generator3630 may be controlled by an external processor (not shown).

The image encoding apparatus 3600 may include one or more data storages(not shown) in which input/output data of the motion information encoder3610 and the generator 3630 are stored. The image encoding apparatus3600 may include a memory controller (not shown) for controlling datainput/output to/from the data storages (not shown).

In order to encode an image, the image encoding apparatus 3600 mayperform an image encoding operation including prediction in associationwith an internal video encoding processor or an external video encodingprocessor. The internal video encoding processor of the image encodingapparatus 3600 according to an embodiment may perform a base imageencoding operation as a separate processor, or a central processing unitor a graphics processing unit may include an image encoding processingmodule and may perform a base image encoding operation.

The image encoding apparatus 3600 may be included in the image encodingapparatus 200. For example, the generator 3630 may be included in thebitstream generator 210 of the image encoding apparatus 200 of FIG. 2,and the motion information encoder 3610 may be included in the encoder220 of the image encoding apparatus 200.

The motion information encoder 3610 encodes a motion vector of a currentblock. The current block that is generated by being split according to atree structure from an image may correspond to, for example, a largestcoding unit, a coding unit, or a transform unit. The motion informationencoder 3610 may determine a prediction mode to be applied to thecurrent block. The prediction mode may include at least one from among,for example, an intra mode, an inter mode, a merge mode, a direct mode,a skip mode, and a preset mode according to the present disclosure.

The generator 3630 generates a bitstream including information generatedas a result of encoding the motion vector of the current block. In anembodiment, the bitstream may include at least one from amonginformation indicating whether the preset mode is applied to the currentblock, information indicating a base motion vector of the current block,information indicating a prediction motion vector of the current block,information indicating a disparity distance for determining predictionmotion vector candidates from a base motion vector candidate,information indicating a disparity direction for determining theprediction motion vector candidates from the base motion vectorcandidate, information indicating a priority of base motion vectorcandidates, information indicating a priority of disparity distances,and information indicating a priority of disparity directions.

The generator 3630 may cause the information to be included in thebitstream corresponding to at least one of a coding unit level, atransform unit level, a largest unit level, a slice unit level, and apicture unit level.

The motion information encoder 3610 may determine whether the presetmode is applied to the current block.

The motion information encoder 3610 may determine whether the presetmode is applied to the current block, based on information related to atleast one of the current block, a previously encoded block, a currentslice, a previously encoded slice, a current picture, and a previouslyencoded picture.

In an example, the motion information encoder 3610 may determine whetherthe preset mode is applied to the current block, in consideration ofstatistical information about a prediction mode in a previous slice or aprevious picture. The motion information encoder 3610 may determine thatthe preset mode is not applied to the current block based on thestatistical information.

In an example, the motion information encoder 3610 may determine thatthe preset mode is applied to the current block based on a costcorresponding to each of various prediction modes applicable to thecurrent block. A rate-distortion cost may be used during costcalculation.

In an example, the motion information encoder 3610 may first determinethat a prediction mode different from the preset mode is applied to thecurrent block, and then may determine whether the preset mode is appliedto the current block. For example, the motion information encoder 3610may determine that the skip mode or the direct mode is applied to thecurrent block, and then may determine whether the preset mode isapplied.

When the preset mode is applied to the current block, the motioninformation encoder 3610 may determine one or more prediction motionvector candidates for each of one or more base motion vector candidates.The one or more prediction motion vector candidates may be classifiedaccording to a disparity distance and a disparity direction.

The motion information encoder 3610 may determine the one or moreprediction motion vector candidates changed by a disparity distancepre-determined based on a base pixel unit from each of the one or morebase motion vector candidates. The motion information encoder 3610 maydetermine a disparity distance for determining the one or moreprediction motion vector candidates according to a pre-determinedcriterion. In an embodiment, information indicating the disparitydistance for determining the one or more prediction motion vectorcandidates may be signaled to the image decoding apparatus 2100 throughthe bitstream, or the image decoding apparatus 2100 may determine thedisparity distance for determining the one or more prediction motionvector candidates by using the same criterion as that of the imageencoding apparatus 3600.

In an embodiment, the motion information encoder 3610 may scale thepre-determined disparity distance according to a ratio between the basepixel unit and a smallest pixel unit indicatable by the motion vector ofthe current block, and may determine the one or more prediction motionvector candidates according to the scaled disparity distance.

A process of determining the prediction motion vector candidatesaccording to the pre-determined disparity distance or the scaleddisparity distance has been described with reference to FIGS. 22 through26, and thus detailed descriptions thereof will not be provided here.

As described above, when a smallest pixel unit indicatable by the basemotion vector candidate and the smallest pixel unit indicatable by themotion vector of the current block are different from each other, themotion information encoder 3610 may change the base motion vectorcandidate, and then may determine the prediction motion vector candidatebased on the changed base motion vector candidate.

In an embodiment, the one or more base motion vector candidates of thecurrent block may be determined based on a motion vector of aneighboring block that is spatially and temporally related to thecurrent block. The neighboring block that is spatially and temporallyrelated to the current block may include a block that is encoded earlierthan the current block.

In an embodiment, the motion information encoder 3610 may determinemotion vectors of the neighboring block related to the current block asthe one or more base motion vector candidates. Alternatively, the motioninformation encoder 3610 may change the motion vectors of theneighboring block related to the current block and may determine the oneor more base motion vector candidates. Alternatively, the motioninformation encoder 3610 may determine the one or more base motionvector candidates by combining the motion vectors of the neighboringblock related to the current block according to a predeterminedequation.

In an embodiment, the motion information encoder 3610 may determinemotion vectors of the neighboring blocks related to the current block inwhich a POC difference of a reference picture between the motion vectorsis equal to or greater than a preset value as the base motion vectorcandidates.

In an embodiment, the motion information encoder 3610 may determine theone or more base motion vector candidates in the same manner as a methodof determining a candidate list of a motion vector predictor in an AMVPmode or a merge mode of HEVC.

In an embodiment, the motion information encoder 3610 may determine azero motion vector having 0 as a component as the one or more basemotion vector candidates.

When the prediction motion vector candidates are determined, the motioninformation encoder 3610 may determine the prediction motion vector ofthe current block from among the determined prediction motion vectorcandidates. After the motion vector of the current block is determined,the motion information encoder 3610 may compare the determined motionvector with the prediction motion vector candidates and may determine aprediction motion vector candidate closest to the motion vector of thecurrent block as the prediction motion vector of the current block.

In an example, the motion information encoder 3610 may determine theprediction motion vector of the current block in consideration ofstatistical information in a previous slice or a previous picture. Inanother example, the motion information encoder 3610 may determine theprediction motion vector of the current block based on a cost betweenthe prediction motion vector candidates.

When the prediction motion vector of the current block is determined,the generator 3630 may generate a bitstream including informationindicating the base motion vector of the current block and informationindicating the prediction motion vector. When the number of base motionvector candidates of the current block is 1, the information indicatingthe base motion vector may not be included in the bitstream.

The information indicating the prediction motion vector may include atleast one from among information indicating a disparity information forspecifying the prediction motion vector of the current block andinformation indicating a disparity direction for specifying theprediction motion vector of the current block.

In an embodiment, the disparity distance for specifying the predictionmotion vector of the current block may be a value determined based onthe base pixel unit. For example, due to a difference between the basepixel unit and the smallest pixel unit indicatable by the motion vectorof the current block, when the prediction motion vector candidates aredetermined after the pre-determined disparity distance is scaled, thedisparity distance for specifying the prediction motion vector of thecurrent block may correspond to the disparity distance before beingscaled. In other words, when the smallest pixel unit indicatable by themotion vector of the current block is a ⅛ pixel unit, the base pixelunit is a ¼ pixel unit, and the prediction motion vector candidates aredetermined according to a disparity distance of 2 that is scaled to betwice a pre-determined disparity distance of 1, although the predictionmotion vector of the current block corresponds to the scaled disparitydistance of 2, information indicating the disparity distance of 1 may beincluded in the bitstream.

The information indicating the base motion vector of the current blockmay be encoded by using an FLC method, a unary coding method, or atruncated unary coding method and may be included in the bitstream.

In an embodiment, the generator 3630 may generate the bitstreamincluding information indicating the smallest pixel unit indicatable bythe motion vector of the current block. The generator 3630 may cause theinformation indicating the smallest pixel unit in the bitstreamcorresponding to a level of at least one of a block, a slice, and apicture.

In an embodiment, at least one from among the information indicating thedisparity distance for specifying the prediction motion vector of thecurrent block and the information indicating the disparity direction maybe included in the bitstream of a transform unit level, a coding unitlevel, a largest coding unit level, a slice level, or a picture level.

The information indicating the disparity distance and the disparitydirection for specifying the prediction motion vector of the currentblock may be encoded by using an FLC method, a unary coding method, or atruncated unary coding method and may be included in the bitstream.

The generator 3630 may encode the information indicating the disparitydirection, e.g., at least one of indexes indicating the disparitydirection, by using a context model.

When the prediction motion vector of the current block is determined,the motion information encoder 3610 may determine a differential motionvector of the current block by using the prediction motion vector of thecurrent block and the motion vector of the current block. In anembodiment, the motion information encoder 3610 may determine adifference between the motion vector of the current block and theprediction motion vector of the current block as the differential motionvector.

The generator 3630 may cause information indicating the differentialmotion vector to be included in the bitstream. In an example,information the differential motion vector may be encoded by using anexponential Golomb coding method and may be included in the bitstream.

In an embodiment, when a prediction direction of the current block is abi-direction, the differential motion vector may be included in thebitstream for only one uni-direction. For example, the informationindicating the differential motion vector may be included in thebitstream for one uni-direction from among a list 0 direction and a list1 direction.

The generator 3630 may encode an index indicating the prediction motionvector of the current block and may cause the encoded index to beincluded in the bitstream, and to this end, the motion informationencoder 3610 may assign indexes to the one or more base motion vectorcandidates and the one or more prediction motion vector candidates.

Referring to FIG. 28, reference numeral 2801 may denote a bitrepresentation corresponding to an index indicating a base motion vectorcandidate, reference numeral 2802 may denote a bit representationcorresponding to an index indicating a disparity distance (or acandidate group) of a prediction motion vector candidate, and referencenumerals 2803 and 2804 may denote a bit representation corresponding toan index indicating a disparity direction of the prediction motionvector candidate.

In order to specify a base motion vector of a current block, the motioninformation encoder 3610 may assign an index to each of one or more basemotion vector candidates. Also, the motion information encoder 3610 mayassign an index to each of prediction motion vector candidates tospecify a prediction motion vector of the current block.

Referring to FIG. 28, an index of 0 may be assigned to a base motionvector candidate 0, and an index of 10 may be assigned to a base motionvector candidate 1. An index indicating each of the base motion vectorcandidates may be represented by using a unary coding method or atruncated unary coding method.

The number of bits representing an index may increase from the basemotion vector candidate 0 to a base motion vector candidate 4, and apriority between base motion vector candidates for assigning an indexmay be determined according to a preset criterion.

In an embodiment, the motion information encoder 3610 may determine thepriority between the base motion vector candidates for the currentblock, in consideration of a ratio or the number of times a base motionvector candidate is selected as a base motion vector in a previous sliceor a previous picture from among the base motion vector candidates. Forexample, when a base motion vector candidate 3 is most selected as abase motion vector of a block in the previous slice or the previouspicture, the motion information encoder 3610 may assign an index of 0 tothe base motion vector candidate 3.

Also, in an embodiment, the motion information encoder 3610 maydetermine the priority between the base motion vector candidates for thecurrent block in consideration of a size of the current block, atemporal layer of a current picture, a GOP size, and a POC differencebetween the current picture and a reference picture.

In an embodiment, information indicating the priority between the basemotion vector candidates for assigning an index may be included in abitstream. The information indicating the priority between the basemotion vector candidates may include information about a changedpriority number in comparison with the priority between the base motionvector candidates determined in a previous block, a previous slice, or aprevious picture. Alternatively, in an embodiment, the image decodingapparatus 2100 may determine the priority by using the same criterion asthat of the image encoding apparatus 3600, instead of not including theinformation indicating the priority between the base motion vectorcandidates in the bitstream.

Prediction motion vector candidates determined to correspond to one basemotion vector candidate may be grouped into a candidate group accordingto a predetermined criterion. The predetermined criterion may be howmuch disparity distance the prediction motion vector candidates arespaced apart from the base motion vector candidate. An index of eachcandidate group may be represented by using a unary coding method or atruncated unary coding method. According to an embodiment, an index ofeach candidate group may be represented by using an FLC method.

Referring to FIG. 28, the number of bits for representing an index of acandidate group may increase from a candidate group 0 corresponding to adisparity distance of 1 to a candidate group 7 corresponding to adisparity distance of 8, and a priority between candidate groups forassigning an index may be determined according to a preset criterion.

In an embodiment, the motion information encoder 3610 may determine thepriority between the candidate groups for the current block, inconsideration of a ratio or the number of times a prediction motionvector candidate is selected to specify a prediction motion vector in aprevious slice or a previous picture from among the candidate groups.For example, when a prediction motion vector candidate included in acandidate group 3 is most selected as a prediction motion vector of ablock in the previous slice or the previous picture, the motioninformation encoder 3610 may assign an index of 0 to the candidate group3.

Also, in an embodiment, the motion information encoder 3610 maydetermine the priority between the candidate groups for the currentblock in consideration of a size of the current block, a temporal layerof a current picture, a GOP size, and a POC difference between thecurrent picture and a reference picture.

In an embodiment, information indicating the priority between thecandidate groups for assigning an index may be included in a bitstream.The information indicating a priority between the candidate groups mayinclude information about a changed priority number in comparison withthe priority between the candidate groups determined in a previousblock, a previous slice, or a previous picture. Alternatively, in anembodiment, the image decoding apparatus 2100 may determine the priorityby using the same criterion as that of the image encoding apparatus3600, instead of not including the information indicating the prioritybetween the candidate groups in the bitstream.

The candidate group 0 of FIG. 28 may include candidates spaced apart bya disparity distance of 1 from a base motion vector candidate, and in anembodiment, a candidate group 0 may include a candidate spaced apart bya distance of 0 from the base motion vector candidate. Because thecandidate spaced apart by a distance of 0 from the base motion vectorcandidate is the base motion vector candidate itself, as described withreference to FIGS. 22 through 25, when the base motion vector candidatecorresponds to (x, y), a prediction motion vector candidate becomes (x,y). When a prediction motion vector of a current block is included inthe candidate group 0, the generator 3630 may not include informationindicating a disparity direction in a bitstream.

When one base motion vector is determined for the current block andinformation indicating a candidate group indicates the candidate group0, unless there is a differential motion vector, the base motion vectoris a motion vector of the current block, and thus a merge mode or a sipmode of conventional HEVC may be replaced.

An index (or a flag) indicating a disparity direction may be assigned toprediction motion vector candidates included in one candidate group. Theindex indicating the disparity direction may be represented by using anFLC method. For example, when four prediction motion vector candidatesare included in one candidate group, two bits may be assigned toindicate each of the four prediction motion vector candidates.

The motion information encoder 3610 may classify prediction motionvector candidates included in one candidate group into groups accordingto locations in a coordinate plane, and may assign an index or a flagcorresponding to each of the classified groups.

Referring to FIG. 28, according to whether prediction motion vectorcandidates (x+1, y), (x−1, y), (x, y+1), and (x, y−1) corresponding tothe candidate group 0 of the base motion vector candidate 0 are changedfrom the base motion vector candidate 0 in an x-axis direction or ay-axis direction, an index (or a flag) of 0 or 1 may be assigned asshown in the bit representation 2803, and according to the predictionmotion vector candidates (x+1, y), (x−1, y), (x, y+1), and (x, y−1) arechanged in a + direction or a − direction, an index (or a flag) of 0 or1 may be assigned as shown in the bit representation 2804.

In an embodiment, the generator 3630 may entropy encode at least one ofinformation indicating a disparity distance and information indicating adisparity direction for specifying a prediction motion vector of acurrent block according to a predetermined context model.

When two candidate groups corresponding to two disparity distances areconfigured for one base motion vector candidate, the generator 3630 mayentropy encode the information indicating the disparity distance of theprediction motion vector of the current block according to apredetermined context model. In this case, the information indicatingthe disparity distance may be binarized according to an FLC method, andthen may be entropy encoded and may be included in a bitstream.

In an embodiment, the generator 3630 may encode at least one of indexesindicating the disparity direction by using a context model. Forexample, the generator 3630 may divide four prediction motion vectorcandidates included in one candidate group into two groups including twocandidates changed in an x-axis direction and two candidates changed ina y-axis direction based on a base motion vector candidate, and mayencode, according to a context model, an index (2803) indicating whethera candidate is changed in the x-axis direction or the y-axis direction.When it is determined whether the candidate is changed in the x-axisdirection or the y-axis direction, the generator 3630 may encode,according to a context model, an index (2804) indicating whether thecandidate is changed in the + direction or the − direction.

In an embodiment, the motion information encoder 3610 may cause only acandidate located at a preset point in a coordinate plane to be includedin each candidate group. For example, the motion information encoder3610 may cause only candidates changed in the x-axis or candidateschanged in the y-axis to be included in each candidate group, based oninformation about at least one of a previous picture, a current picture,a previous slice, a current slice, a previous block, and a currentblock. For example, from among candidates (x+1, y), (x−1, y), (x, y+1),and (x, y−1) included in the candidate group 0 of FIG. 28, only thecandidates (x+1, y) and (x−1, y) changed along the x-axis may beincluded in the candidate group 0, and an index corresponding to the bitrepresentation 2804 may be assigned to each candidate to divide thecandidates (x+1, y) and (x−1, y) and may be encoded according to acontext model.

In an embodiment, when two base motion vector candidates of a currentblock are determined, the generator may entropy encode informationindicating a base motion vector of the current block according to apredetermined context model and may cause the information to be includedin a bitstream. In this case, the information indicating the base motionvector may be binarized according to an FLC method, and then may beentropy encoded and may be included in the bitstream.

In an embodiment, when at least one from among the informationindicating the base motion vector, information indicating a disparitydistance, and information indicating a disparity direction is to beentropy encoded, the generator 3630 may select a context model for atleast one from among the information indicating the base motion vector,the information indicating the disparity distance, and the informationindicating the disparity direction from among one or more context modelsbased on information related to neighboring blocks adjacent to thecurrent block.

The neighboring blocks may include, but are not limited to, a left blockadjacent to a left side of the current block and an upper block adjacentto an upper side of the current block.

The generator 3630 may select a context model based on informationrelated to a neighboring block encoded by applying the same mode as apreset mode applied to the current block from among the neighboringblocks adjacent to the current block.

In an example, the generator 3630 may select a context model for thecurrent block based on the information related to the neighboring blockto which the same mode as the preset mode applied to the current blockis applied, for example, at least one of the information indicating thebase motion vector, the information indicating the disparity distance,and the information indicating the disparity direction.

In an embodiment, when sizes of a motion vector of the upper block towhich the preset mode is applied and a motion vector of the left blockto which the preset mode is applied in the x-axis direction are greaterthan a reference value, the generator 3630 may select a first contextmodel. Also, when a size of a motion vector of the left block to whichthe preset mode is applied in the x-axis direction is greater than areference value or a size of a motion vector of the upper block to whichthe preset mode is applied in the x-axis direction is greater than areference value, the generator 3630 may select a second context model.Also, when sizes of a motion vector of the upper block to which thepreset mode is applied and a motion vector of the left block to whichthe preset mode is applied in the x-axis direction are equal to or lessthan a reference value, the generator 3630 may select a third contextmodel.

When a base motion vector candidate is a bi-directional motion vector,the motion information encoder 3610 may cause each of prediction motionvector candidates classified according to a disparity distance and adisparity direction to include a prediction motion vector candidate fora list 0 direction and a prediction motion vector candidate for a list 1direction. A method of determining a prediction motion vector candidatefor a bi-direction is the same as that made in relation to the imagedecoding apparatus 2100, and thus detailed descriptions thereof will notbe provided.

In an embodiment, when a base motion vector of a current block isdetermined, the motion information encoder 3610 may determine a usedirection of the base motion vector, and the generator 3630 may causeinformation indicating the use direction of the base motion vector to beincluded in a bitstream.

The base motion vector may correspond to a motion vector for a list 0direction, a motion vector for a list 1 direction, or a motion vectorfor a bi-direction, and the motion information encoder 3610 maydetermine the use direction of the base motion vector to improveencoding efficiency of a motion vector of the current block.

The information indicating the use direction of the base motion vectormay include an index. For example, when the base motion vector isbi-directional, a bit value 0 may indicate that the use direction of thebase motion vector is the bi-direction, a bit value 10 may indicate thatthe use direction of the base motion vector is the list 0 direction, anda bit value 11 may indicate that the use direction of the base motionvector is the list 1 direction.

Also, for example, when the base motion vector is in a firstuni-direction of the list 0 direction or the list 1 direction, the bitvalue 0 may indicate that the use direction of the base motion vector isthe first uni-direction, the bit value 10 may indicate that the usedirection of the base motion vector is a second uni-direction differentfrom the first uni-direction, and the bit value 11 may indicate that theuse direction of the base motion vector is the bi-direction. The usedirection of the base motion vector corresponding to the bit value mayalso be changed.

In an example, when it is determined that a base motion vector is abi-directional and a use direction of the base motion vector is abi-direction, the motion information encoder 3610 may determine adisparity distance and a disparity direction indicating a predictionmotion vector of a list 0 direction of a current block and a disparitydistance and a disparity direction indicating a prediction motion vectorof a list 1 direction. The generator 3630 may cause informationindicating the bi-directional base motion vector, information indicatingthe disparity distance and the disparity direction for the list 0direction of the current block, and information indicating the disparitydistance and the disparity distance for the list 1 direction of thecurrent block to be included in a bitstream.

In another example, when it is determined that a base motion vector isbi-directional and a use direction of the base motion vector is abi-direction, although the motion information encoder 3610 may determinea disparity distance and a disparity direction indicating a predictionmotion vector of a list 0 direction of a current block and a disparitydistance and a disparity direction indicating a prediction motion vectorof a list 1 direction, the generator 3630 may cause informationindicating the disparity distance and the disparity direction for onedirection from among the list 0 direction and the list 1 direction andinformation indicating the bi-directional base motion vector to beincluded in a bitstream.

In another embodiment, when a base motion vector is bi-directional and ause direction of the base motion vector is a first uni-direction of alist 0 direction or a list 1 direction, the motion information encoder3610 may determine a disparity distance and a disparity directionindicating a prediction motion vector of the first uni-direction of acurrent block, and the generator 3630 may cause information indicatingthe base motion vector and information indicating the disparity distanceand the disparity direction for the first uni-direction to be includedin a bitstream.

In another embodiment, when a base motion vector is bi-directional and ause direction of the base motion vector is a first uni-direction of alist 0 direction or a list 1 direction, the motion information encoder3610 may determine a disparity distance and a disparity directionindicating a prediction motion vector of a second uni-directiondifferent from the first uni-direction of a current block, and thegenerator 3630 may cause information indicating the base motion vectorand information indicating the disparity distance and the disparitydirection for the second uni-direction to be included in a bitstream.

In another embodiment, when a base motion vector is in a firstuni-direction of a list 0 direction or a list 1 direction and a usedirection of the base motion vector is a second uni-direction differentfrom the first uni-direction, the motion information encoder 3610 maydetermine a disparity distance and a disparity direction indicating aprediction motion vector of the first uni-direction, and the generator3630 may cause information indicating the base motion vector,information indicating the disparity distance for the firstuni-direction, and information indicating the disparity direction forthe first uni-direction to be included in a bitstream.

In another example, when a base motion vector is in a firstuni-direction of a list 0 direction or a list 1 direction and a usedirection of the base motion vector is a bi-direction, the motioninformation encoder 3610 may determine a disparity distance and adisparity direction indicating a prediction motion vector of the firstuni-direction, and the generator 3630 may cause information indicatingthe base motion vector, information indicating the disparity distancefor the first uni-direction, and information indicating the disparitydirection for the first uni-direction to be included in a bitstream.

In an embodiment, the motion information encoder 3610 may determinewhether multi-pass coding is to be applied to a current block. Themotion information encoder 3610 may encode the current block accordingto two different prediction modes, and may select one prediction modebased on a cost. The generator 3630 may cause information indicatingwhether the current block is multi-pass coded and information about aprediction mode applied to the current block when multi-pass coding isapplied, to be included in a bitstream.

The two different prediction modes may include one of an AMVP mode, amerge mode, a direct mode, and a skip mode, and a preset mode accordingto the present disclosure.

In an embodiment, the motion information encoder 3610 may determinewhether a parent block is split, and may split the parent block into afirst child block corresponding to the current block and a second childblock adjacent to the first child block. According to an embodiment, themotion information encoder 3610 may determine whether the parent blockis split, and may split the parent block into the first child blockcorresponding to the current block, and the second child block and athird child block adjacent to the first child block.

The motion information encoder 3610 may encode the first child blockaccording to the preset mode, and the generator 3630 may generate abitstream including information generated as a result of encoding thefirst child block.

In order to encode the second child block, like for the first childblock, the motion information encoder 3610 may encode the second childblock according to the preset mode according to the present disclosure.In this case, base motion vector candidates and prediction motion vectorcandidates determined for the parent block may also be used for thefirst child block and the second child block. In other words, the basemotion vector candidates and the prediction motion vector candidates maybe determined at a parent block level, a base motion vector of the firstchild block and a base motion vector of the second child block fromamong the base motion vector candidates may be independently determined,and a prediction motion vector of the first child block and a predictionmotion vector of the second child block from among the prediction motionvector candidates may be independently determined.

In another example, the motion information encoder 3610 may determine amotion vector determined for the first child block as a base motionvector of the second child block, and may determine a prediction motionvector of the second child block from among prediction motion vectorcandidates corresponding to the base motion vector. The generator 3630may cause information indicating the base motion vector of the secondchild block not to be included in a bitstream, and instead, may causeinformation indicating the prediction motion vector of the second childblock to be included in the bitstream.

In another example, at least one from among the base motion vector, thedisparity distance, and the disparity direction determined in relationto the first child block may be applied to the second child block. Inthis case, the motion information encoder 3610 may encode a motionvector of the second child block by using at least one from among thebase motion vector, the disparity distance, and the disparity directiondetermined in relation to the first child block.

Also, the motion information encoder 3610 may determine a differentialmotion vector related to one block from among the first child block andthe second child block, and the generator 3630 may cause informationindicating the determined differential motion vector to be included inthe bitstream.

In an embodiment, the motion information encoder 3610 may encode thefirst child block in the preset mode according to the presentdisclosure, and the second child block may be encoded in a modedifferent from the preset mode applied to the first child block.

FIG. 37 is a flowchart for describing an image encoding method accordingto an embodiment.

In operation S3710, an image encoding apparatus 3600 scales one or moredisparity distances that are pre-determined based on a base pixel unit,based on a smallest pixel unit indicatable by a motion vector of acurrent block.

The image encoding apparatus 3600 may up-scale the one or morepre-determined disparity distances when the smallest pixel unit is lessthan the base pixel unit.

In operation S3720, the image encoding apparatus 3600 determines one ormore prediction motion vector candidates changed according to the one ormore disparity distances scaled from a base motion vector candidate,according to each of one or more base motion vector candidates.

In operation S3730, the image encoding apparatus 3600 determines aprediction motion vector of the current block form among the one or moreprediction motion vector candidates.

The image encoding apparatus 3600 may determine a base motion vector ofthe current block from among the one or more base motion vectorcandidates, and then may determine the prediction motion vector of thecurrent block from among the one or more prediction motion vectorcandidates corresponding to the determined base motion vector.

The image encoding apparatus 3600 may determine a prediction motionvector candidate most similar to the motion vector of the current blockas the prediction motion vector of the current block.

In operation S3740, the image encoding apparatus 3600 generates abitstream including information indicating a disparity distance forspecifying a prediction motion vector candidate determined as theprediction motion vector of the current block. The disparity distancecorresponding to information included in the bitstream may be thedisparity distance before being scaled.

Also, the image encoding apparatus 3600 may cause at least one fromamong information indicating the base motion vector of the current blockand information indicating the disparity direction for specifying theprediction motion vector of the current block to be further included inthe bitstream.

The bitstream may include at least one from among information indicatingwhether a preset mode is applied to the current block, informationindicating the base motion vector of the current block, informationindicating the prediction motion vector of the current block,information indicating the disparity distance for determining theprediction motion vector candidates from the base motion vectorcandidate, information indicating the disparity direction fordetermining the prediction motion vector candidates from the base motionvector candidate, information indicating a priority of base motionvector candidates, information indicating a priority of disparitydistances, and information indicating a priority of disparitydirections. The image encoding apparatus 3600 may cause the informationto be included in the bitstream corresponding to at least one level of acoding unit level, a transform unit level, a largest coding unit level,a slice unit level, and a picture unit level.

The embodiments may be implemented as a computer-executable program, andthe program may be stored in a medium.

The medium may continuously store the computer-executable program, ormay temporally store the computer-executable program to execute ordownload the computer-executable program. Also, the medium may be any ofvarious recording means or storage means including single hardware or acombination of a plurality of hardware, and may be distributed in anetwork without being limited to a medium directly connected to acomputer system. The medium may be configured to store programinstructions, and examples of the medium may include a magnetic mediumsuch as a hard disk, a floppy disk, or a magnetic tape, an opticalrecording medium such as a compact disc read-only memory (CD-ROM) or adigital versatile disc (DVD), a magneto-optical medium such as afloptical disk, a ROM, a random-access memory (RAM), and a flash memory.Also, other examples of the medium may include a recording medium and astorage medium managed by an application store that distributesapplications or a site or a server that supplies or distributes variousother software.

While the present disclosure has been particularly shown and describedwith reference to embodiments thereof, it will be understood by one ofordinary skill in the art that various changes in form and details maybe made therein without departing from the spirit and scope of thepresent disclosure as defined by the appended claims.

1. An apparatus of decoding motion information, the apparatuscomprising: an obtainer configured to obtain, from a bitstream,information about a precision of a pixel unit in a predetermined mode,information indicating a disparity distance for a current block, andinformation indicating a disparity direction for the current block; anda motion information decoder configured to: if the precision of thepixel unit is a predetermined precision, determine a first disparitydistance based on the obtained information indicating the disparitydistance; if the precision of the pixel unit is not the predeterminedprecision, determine a second disparity distance based on the obtainedinformation indicating the disparity distance; and if the current blockis bi-predicted: determine a first motion vector for a first list of thecurrent block by changing a first base motion vector for the first listby a first offset, wherein the first offset has a size corresponding tothe first disparity distance or the second disparity distance, and asign of the first offset corresponds to the information indicating thedisparity direction; determine a second offset by scaling the firstoffset based on a difference between a picture order count (POC) of acurrent picture and a POC of a first reference picture in the firstlist, and a difference between the POC of the current picture and a POCof a second reference picture in a second list; and determine a secondmotion vector for the second list of the current block by changing asecond base motion vector for the second list by the second offset,wherein the second disparity distance is larger than the first disparitydistance.
 2. An apparatus of encoding motion information, the apparatuscomprising: a motion vector encoder configured to: determine a precisionof a pixel unit in a predetermined mode; if a current block isbi-predicted, determine a first base motion vector for a first list anda second base motion vector for a second list; and determine a firstoffset corresponding to a difference between the first base motionvector and a first motion vector for the first list of the currentblock; and a generator configured to generate a bitstream comprisinginformation about the precision of the pixel unit, informationindicating a disparity distance corresponding to a size of the firstoffset and information indicating a disparity direction corresponding toa sign of the first offset, wherein if the precision of the pixel unitis a predetermined precision, the information indicating the disparitydistance indicates a first disparity distance, if the precision of thepixel unit is not the predetermined precision, the informationindicating the disparity distance indicates a second disparity distance,wherein a second offset corresponding to a difference between the secondbase motion vector and a second motion vector for the second list of thecurrent block is determined by scaling the first offset based on adifference between a picture order count (POC) of a current picture anda POC of a first reference picture in the first list, and a differencebetween the POC of the current picture and a POC of a second referencepicture in the second list, and wherein the second disparity distance islarger than the first disparity distance.